Massive Text Embedding Benchmark (MTEB) Leaderboard. To submit, refer to the MTEB GitHub repository 🤗 Refer to the MTEB paper for details on metrics, tasks and models.
Overall MTEB English leaderboard 🔮
Rank | Model | Embedding Dimensions | Sequence Length | Average (56 datasets) | Classification Average (12 datasets) | Clustering Average (11 datasets) | Pair Classification Average (3 datasets) | Reranking Average (4 datasets) | Retrieval Average (15 datasets) | STS Average (10 datasets) | Summarization Average (1 dataset) |
|---|---|---|---|---|---|---|---|---|---|---|---|
1 | 1024 | 512 | 62.25 | 75.24 | 44.49 | 86.03 | 56.61 | 50.56 | 82.05 | 30.19 | |
2 | 768 | 512 | 61.79 | 73.12 | 44.74 | 86.62 | 57.29 | 49.26 | 83.06 | 32.32 | |
3 | 768 | 512 | 61.59 | 73.86 | 45.29 | 85.89 | 57.54 | 47.57 | 83.15 | 31.84 | |
4 | 768 | 512 | 61.5 | 73.84 | 43.8 | 85.73 | 55.91 | 50.29 | 81.05 | 30.28 | |
5 | 1024 | 514 | 61.5 | 74.81 | 41.06 | 84.75 | 55.86 | 51.43 | 81.56 | 29.69 | |
6 | 1024 | 512 | 61.42 | 73.14 | 43.33 | 85.94 | 56.53 | 49.99 | 82.06 | 30.97 | |
7 | 1536 | 8191 | 60.99 | 70.93 | 45.9 | 84.89 | 56.32 | 49.25 | 80.97 | 30.8 | |
8 | 768 | 512 | 60.44 | 72.63 | 42.11 | 85.09 | 55.7 | 48.75 | 80.96 | 31.01 | |
9 | 384 | 512 | 59.93 | 72.94 | 39.92 | 84.67 | 54.32 | 49.04 | 80.39 | 31.16 | |
10 | 768 | 512 | 59.54 | 72.36 | 41.9 | 83.51 | 56.2 | 45.12 | 82.29 | 29.85 | |
11 | 768 | 512 | 59.51 | 73.42 | 43.72 | 85.06 | 56.42 | 42.24 | 82.63 | 30.08 | |
12 | 768 | 514 | 59.45 | 73.02 | 37.89 | 83.57 | 54.84 | 48.88 | 80.26 | 30.11 | |
13 | 768 | 512 | 58.97 | 67.41 | 42.42 | 86.12 | 56.66 | 48.48 | 78.38 | 30.64 | |
14 | 4096 | 2048 | 58.93 | 68.13 | 40.34 | 82 | 56.56 | 50.25 | 78.1 | 31.46 | |
15 | 384 | 512 | 58.89 | 71.67 | 39.51 | 85.08 | 54.45 | 46.01 | 80.87 | 31.39 | |
16 | 768 | 512 | 58.42 | 67.11 | 41.51 | 86.13 | 55.96 | 47.96 | 77.8 | 30.21 | |
17 | 768 | 512 | 58.28 | 67.14 | 41.6 | 85.32 | 55.36 | 47.42 | 78.19 | 29.5 | |
18 | 384 | 512 | 57.87 | 70.74 | 37.08 | 82.59 | 53.87 | 46.64 | 79.1 | 29.98 | |
19 | 768 | 512 | 57.87 | 72.84 | 42.34 | 86.06 | 54.71 | 38.47 | 81.66 | 29.91 | |
20 | 768 | 514 | 57.78 | 65.07 | 43.69 | 83.04 | 59.36 | 43.81 | 80.28 | 27.49 | |
21 | 4096 | 2048 | 57.59 | 66.19 | 38.93 | 81.9 | 55.65 | 48.22 | 77.74 | 33.6 | |
22 | 2560 | 2048 | 57.17 | 67.13 | 39.83 | 80.65 | 54.67 | 46.54 | 76.83 | 31.03 | |
23 | 768 | 512 | 57.06 | 72.31 | 41.65 | 84.97 | 54 | 36.71 | 81.83 | 29.64 | |
24 | 384 | 512 | 56.53 | 63.21 | 41.81 | 82.41 | 58.44 | 42.69 | 79.8 | 27.9 | |
25 | 384 | 512 | 56.26 | 63.05 | 42.35 | 82.37 | 58.04 | 41.95 | 78.9 | 30.81 | |
26 | 2048 | 2048 | 56.2 | 66.52 | 39.92 | 79.58 | 54 | 44.49 | 75.74 | 30.43 | |
27 | 768 | 512 | 56.19 | 65.25 | 38.63 | 83.85 | 54.23 | 44.67 | 77.07 | 29.67 | |
28 | 768 | 512 | 56 | 66.68 | 41.1 | 82.54 | 53.14 | 41.88 | 76.51 | 30.36 | |
29 | 768 | 512 | 55.27 | 69.81 | 40.21 | 85.18 | 53.09 | 33.63 | 81.14 | 31.39 | |
30 | 768 | 514 | 54.71 | 67.9 | 38.4 | 80.81 | 53.8 | 35.34 | 80.73 | 31.57 | |
31 | 4096 | 2048 | 53.74 | 70.14 | 36.98 | 77.03 | 52.33 | 32.34 | 80.53 | 30.38 | |
32 | 384 | 512 | 52.44 | 64.3 | 37.14 | 78.45 | 53.62 | 32.45 | 78.93 | 30.67 | |
33 | 768 | 512 | 52.35 | 64.71 | 37.64 | 81.74 | 51.84 | 32.96 | 76.47 | 29.5 | |
34 | 768 | 2048 | 51.25 | 60.72 | 35.79 | 75.23 | 50.58 | 37.04 | 73.41 | 29.71 | |
35 | 1024 | 2046 | 49.52 | 70.44 | 37.52 | 76.86 | 49.02 | 18.36 | 78.6 | 26.94 | |
36 | 768 | 512 | 48.87 | 67.32 | 33.43 | 73.68 | 47.54 | 21.82 | 79.12 | 31.17 | |
37 | 768 | 2048 | 45.97 | 61.46 | 30.95 | 71.78 | 47.56 | 20.9 | 74.71 | 30.26 | |
38 | 768 | 512 | 45.45 | 62.5 | 29.04 | 70.33 | 46.47 | 20.29 | 74.33 | 31.15 | |
39 | 768 | 512 | 45.21 | 62.71 | 29.55 | 78.87 | 48.42 | 18.99 | 70.8 | 31.05 | |
40 | 300 | N/A | 42.06 | 57.65 | 26.57 | 72.94 | 44.75 | 21.22 | 62.46 | 30.49 | |
41 | 300 | N/A | 41.96 | 57.29 | 27.73 | 70.92 | 43.29 | 21.62 | 61.85 | 28.87 | |
42 | 768 | 512 | 40.28 | 52.37 | 34.06 | 61.37 | 48.1 | 15.88 | 61.02 | 27.66 | |
43 | 768 | 512 | 38.33 | 61.66 | 30.12 | 56.33 | 43.44 | 10.59 | 54.36 | 29.82 | |
44 | 1024 | N/A | 34.95 | 53.18 | 15.28 | 68.86 | 41.44 | 7.94 | 63.27 | 26.8 | |
45 | 768 | 514 | |||||||||
46 | 768 | 512 | |||||||||
47 | 1024 | 512 | |||||||||
48 | 768 | 512 | |||||||||
49 | 1024 | 512 | |||||||||
50 | 768 | 512 | |||||||||
51 | 2048 | 2046 | 77.46 | ||||||||
52 | 4096 | 2046 | 77.79 | ||||||||
53 | 12288 | 2046 | 75.9 | ||||||||
54 | 1024 | 2046 | |||||||||
55 | 1024 | 2046 | |||||||||
56 | 2048 | 2046 | |||||||||
57 | 4096 | 2046 | |||||||||
58 | 12288 | 2046 | |||||||||
59 | 768 | 512 | |||||||||
60 | 1024 | 514 | |||||||||
61 | 768 | ||||||||||
62 | 70.78 | 40.58 | 82.15 | 58.88 | 79 | 30.15 | |||||
63 | 65.45 | 43.8 | 83.04 | 59.36 | 80.28 | 27.49 | |||||
64 | 65.78 | 35.06 | 79.62 | 75.35 | 29.71 | ||||||
65 | 63.42 | 34.82 | 75.43 | 75.39 | 30.79 | ||||||
66 | 64.45 | 35.71 | 76.23 | 72.04 | 29.42 | ||||||
67 | 67.9 | 37.82 | 79.53 | 74.05 | 29.01 | ||||||
68 | 64.85 | 74.53 | 75.11 | ||||||||
69 | 30.62 | ||||||||||
70 | |||||||||||
71 | 384 | 512 | 62.23 | 30.61 | 76.49 | 80.24 | 30.1 | ||||
72 | 1024 | 512 | 47.85 | 70.81 | 29.02 | ||||||
73 | 768 | 514 | 61.44 | 37.92 | 82.11 | 55.24 | |||||
74 | 512 | 512 | 60.12 | 32.42 | 78.43 | 53 | 77.19 | 28.96 |
Bitext Mining Leaderboard 🎌
Model | BUCC (de-en) | BUCC (fr-en) | BUCC (ru-en) | BUCC (zh-en) | Tatoeba (afr-eng) | Tatoeba (amh-eng) | Tatoeba (ang-eng) | Tatoeba (ara-eng) | Tatoeba (arq-eng) | Tatoeba (arz-eng) | Tatoeba (ast-eng) | Tatoeba (awa-eng) | Tatoeba (aze-eng) | Tatoeba (bel-eng) | Tatoeba (ben-eng) | Tatoeba (ber-eng) | Tatoeba (bos-eng) | Tatoeba (bre-eng) | Tatoeba (bul-eng) | Tatoeba (cat-eng) | Tatoeba (cbk-eng) | Tatoeba (ceb-eng) | Tatoeba (ces-eng) | Tatoeba (cha-eng) | Tatoeba (cmn-eng) | Tatoeba (cor-eng) | Tatoeba (csb-eng) | Tatoeba (cym-eng) | Tatoeba (dan-eng) | Tatoeba (deu-eng) | Tatoeba (dsb-eng) | Tatoeba (dtp-eng) | Tatoeba (ell-eng) | Tatoeba (epo-eng) | Tatoeba (est-eng) | Tatoeba (eus-eng) | Tatoeba (fao-eng) | Tatoeba (fin-eng) | Tatoeba (fra-eng) | Tatoeba (fry-eng) | Tatoeba (gla-eng) | Tatoeba (gle-eng) | Tatoeba (glg-eng) | Tatoeba (gsw-eng) | Tatoeba (heb-eng) | Tatoeba (hin-eng) | Tatoeba (hrv-eng) | Tatoeba (hsb-eng) | Tatoeba (hun-eng) | Tatoeba (hye-eng) | Tatoeba (ido-eng) | Tatoeba (ile-eng) | Tatoeba (ina-eng) | Tatoeba (ind-eng) | Tatoeba (isl-eng) | Tatoeba (ita-eng) | Tatoeba (jav-eng) | Tatoeba (jpn-eng) | Tatoeba (kab-eng) | Tatoeba (kat-eng) | Tatoeba (kaz-eng) | Tatoeba (khm-eng) | Tatoeba (kor-eng) | Tatoeba (kur-eng) | Tatoeba (kzj-eng) | Tatoeba (lat-eng) | Tatoeba (lfn-eng) | Tatoeba (lit-eng) | Tatoeba (lvs-eng) | Tatoeba (mal-eng) | Tatoeba (mar-eng) | Tatoeba (max-eng) | Tatoeba (mhr-eng) | Tatoeba (mkd-eng) | Tatoeba (mon-eng) | Tatoeba (nds-eng) | Tatoeba (nld-eng) | Tatoeba (nno-eng) | Tatoeba (nob-eng) | Tatoeba (nov-eng) | Tatoeba (oci-eng) | Tatoeba (orv-eng) | Tatoeba (pam-eng) | Tatoeba (pes-eng) | Tatoeba (pms-eng) | Tatoeba (pol-eng) | Tatoeba (por-eng) | Tatoeba (ron-eng) | Tatoeba (rus-eng) | Tatoeba (slk-eng) | Tatoeba (slv-eng) | Tatoeba (spa-eng) | Tatoeba (sqi-eng) | Tatoeba (srp-eng) | Tatoeba (swe-eng) | Tatoeba (swg-eng) | Tatoeba (swh-eng) | Tatoeba (tam-eng) | Tatoeba (tat-eng) | Tatoeba (tel-eng) | Tatoeba (tgl-eng) | Tatoeba (tha-eng) | Tatoeba (tuk-eng) | Tatoeba (tur-eng) | Tatoeba (tzl-eng) | Tatoeba (uig-eng) | Tatoeba (ukr-eng) | Tatoeba (urd-eng) | Tatoeba (uzb-eng) | Tatoeba (vie-eng) | Tatoeba (war-eng) | Tatoeba (wuu-eng) | Tatoeba (xho-eng) | Tatoeba (yid-eng) | Tatoeba (yue-eng) | Tatoeba (zsm-eng) |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
99.21 | 98.39 | 97.62 | 97.7 | 92.59 | 80.82 | 25.22 | 90.14 | 26.63 | 66.16 | 76.35 | 33.74 | 82.41 | 79.54 | 89.43 | 77.63 | 95.86 | 31.2 | 93.57 | 95.8 | 77.17 | 9.93 | 95.52 | 14.86 | 85.62 | 4.45 | 27.03 | 5.85 | 95.22 | 99.07 | 42.34 | 7.39 | 96.2 | 96.61 | 96.43 | 93.32 | 57.04 | 96.98 | 94.28 | 42.07 | 1.52 | 4.2 | 96.14 | 27.52 | 0 | 95.32 | 96.72 | 45.75 | 95.2 | 88.72 | 80.86 | 87.88 | 93.93 | 92.98 | 94.32 | 94.32 | 9.95 | 93.78 | 65.88 | 81.16 | 53.3 | 74.19 | 87.97 | 19.09 | 4.46 | 64.81 | 63.39 | 96.2 | 95.33 | 98.16 | 92.93 | 36.96 | 6.86 | 93.63 | 3.42 | 77.13 | 95.35 | 72.75 | 95.77 | 60.02 | 58.13 | 23.24 | 3.24 | 93.13 | 36.23 | 97.32 | 94.54 | 96.52 | 92.58 | 95.82 | 95.4 | 97.33 | 97.22 | 93.64 | 95.31 | 33.1 | 55.66 | 87.32 | 34.74 | 96.72 | 63.19 | 96.38 | 16.35 | 98.03 | 36.56 | 56.49 | 93.52 | 84.23 | 23.2 | 96.73 | 8.25 | 75.09 | 4.68 | 2.49 | 87.75 | 95.41 | |
99.35 | 98.72 | 97.78 | 99.16 | 96.18 | 91.47 | 59.28 | 88.8 | 42.69 | 76 | 90.68 | 71.7 | 94.93 | 95 | 88.55 | 8.4 | 94.92 | 15.07 | 94.58 | 95.38 | 79.44 | 64.42 | 96.68 | 31.77 | 95.1 | 10.11 | 52.57 | 92 | 95.71 | 99.2 | 64.81 | 10.85 | 95.35 | 98.2 | 96.55 | 95.01 | 87.4 | 96.37 | 94.86 | 89.31 | 85.66 | 93.8 | 96.82 | 46.5 | 91.53 | 96.87 | 96.95 | 67.11 | 96.55 | 94.09 | 89.42 | 85.58 | 95.37 | 93.66 | 94.75 | 92.72 | 79.77 | 95.38 | 4.31 | 95.02 | 87.49 | 78.37 | 90.95 | 83.59 | 11.33 | 80.07 | 67.54 | 96.47 | 95.88 | 98.45 | 92.65 | 63.26 | 15.74 | 93.6 | 95.91 | 79.42 | 96.07 | 94.48 | 98.4 | 74.38 | 65.81 | 38.93 | 10.73 | 94.7 | 64.57 | 97.22 | 94.14 | 96.92 | 93.75 | 96.5 | 96.03 | 98.4 | 96.76 | 94.43 | 95.63 | 59.36 | 84.5 | 89 | 85.92 | 97.86 | 96.02 | 96.14 | 75.27 | 98 | 58.88 | 92.4 | 93.97 | 93.22 | 84.23 | 97.2 | 60.29 | 90.18 | 91.55 | 88.79 | 89.58 | 95.62 | |
0.18 | 0.19 | 0.1 | 0 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
90.99 | 88.55 | 2.07 | 1.49 | 33.47 | 0.01 | 30.74 | 0.47 | 0.34 | 0.14 | 51.74 | 0.49 | 7.43 | 3.45 | 0.06 | 5.79 | 17.43 | 5.69 | 7.55 | 48.06 | 54.56 | 8.72 | 8.76 | 27.56 | 2.26 | 3.69 | 13.18 | 6.97 | 47.36 | 91.54 | 13.2 | 4.54 | 0.55 | 27.86 | 5.13 | 10.23 | 21.44 | 6.62 | 79.66 | 32.92 | 2.87 | 3.26 | 63.81 | 29.71 | 0.33 | 0.25 | 17.16 | 12.02 | 7.21 | 0.78 | 40.83 | 54.95 | 72.28 | 30.95 | 11.29 | 73.83 | 8.66 | 0.61 | 1.78 | 0.79 | 0.95 | 0.49 | 1.87 | 10.91 | 5.72 | 18.24 | 43.49 | 7.13 | 7.04 | 0.44 | 0.03 | 18.99 | 1.11 | 2.49 | 2.01 | 39.96 | 58.86 | 29.07 | 40.25 | 50.19 | 30.72 | 0.85 | 7.21 | 0.53 | 31.07 | 18.06 | 81.92 | 62.6 | 22.24 | 10.59 | 11.4 | 85.78 | 14.92 | 9.87 | 55.08 | 32.66 | 7.64 | 0.49 | 1.28 | 0.45 | 23.63 | 0.61 | 5.71 | 8.25 | 28.4 | 0.57 | 5.69 | 0 | 4.19 | 9.07 | 12.31 | 1.38 | 7.6 | 0.41 | 1.31 | 29.74 | |
0.18 | 0.08 | 0.15 | 0.05 | 4.82 | 1.18 | 8.54 | 0.63 | 0.4 | 0.63 | 11.69 | 0 | 3.22 | 1.75 | 0.2 | 7 | 9.31 | 4.17 | 1.29 | 7.73 | 5.61 | 4.88 | 3.55 | 19.29 | 0.5 | 4.15 | 5.69 | 8.4 | 6.99 | 3.67 | 5.33 | 4.25 | 0.63 | 2.45 | 2.69 | 4.69 | 7.61 | 3.36 | 7 | 12.36 | 3.07 | 4.81 | 8.12 | 18.87 | 0.68 | 0.1 | 5.41 | 6.32 | 3.42 | 0.97 | 7.1 | 13.61 | 8.57 | 7.26 | 4.09 | 5.54 | 11.43 | 0.2 | 2.71 | 1.11 | 1.17 | 0.55 | 0.5 | 8.55 | 4.61 | 4.07 | 2.83 | 0.95 | 3.25 | 0.29 | 0.2 | 14.53 | 0.2 | 0.2 | 1.1 | 10.37 | 9.5 | 4.49 | 4.95 | 14.53 | 5.8 | 0.24 | 6.65 | 0.5 | 8.05 | 5.13 | 5.87 | 6.76 | 0.2 | 4.23 | 6.05 | 5.03 | 4.36 | 1.77 | 6.72 | 8.54 | 11.49 | 1.3 | 0.77 | 0.85 | 2.61 | 0.69 | 5.76 | 5.24 | 15.51 | 0.6 | 1.23 | 0.4 | 4.73 | 6.55 | 4.12 | 0.2 | 4.33 | 0.59 | 0.5 | 7.27 | |
97.11 | 94.99 | 95.06 | 95.63 | 58.22 | 36.21 | 10.24 | 87.93 | 18.6 | 51.26 | 62.17 | 33.43 | 62.1 | 67.73 | 36.48 | 4.43 | 93.27 | 5.56 | 92.65 | 94.42 | 55.37 | 8.05 | 95.12 | 15.98 | 94.93 | 3.42 | 21.56 | 13.25 | 94.8 | 97.02 | 33.43 | 5.69 | 95.43 | 41.73 | 97.33 | 23.18 | 27.51 | 93.1 | 91.72 | 31.13 | 3.61 | 11.62 | 94 | 25.74 | 86.88 | 97.62 | 95.98 | 36.1 | 91.58 | 93.28 | 40.25 | 57.71 | 79.13 | 92.74 | 24.07 | 93.05 | 17.04 | 90.41 | 1.16 | 95.44 | 34.89 | 32.11 | 92.52 | 46.94 | 6.24 | 19.47 | 47.02 | 93.16 | 97.87 | 32.2 | 92.38 | 45.25 | 6.89 | 91 | 95.04 | 32.16 | 94.58 | 76.34 | 97.73 | 47.99 | 38.57 | 15.1 | 5.41 | 92.59 | 30.7 | 94.28 | 92.13 | 95.3 | 91.87 | 95.15 | 96.92 | 95.42 | 98.17 | 92.24 | 94.42 | 26.31 | 14.48 | 24.64 | 10.25 | 36.4 | 13.09 | 96.72 | 15.16 | 95.08 | 25.46 | 24.39 | 92.82 | 94.57 | 17.14 | 95.12 | 7.25 | 76 | 4.52 | 14.38 | 71.45 | 95.31 | |
98.59 | 96.89 | 96.44 | 97.56 | 72.96 | 53.49 | 16.72 | 90.19 | 19.84 | 55.69 | 70.08 | 42.83 | 76.36 | 79.94 | 64.9 | 4.88 | 94.02 | 6.42 | 93.52 | 96.05 | 58.68 | 7.39 | 95.73 | 12.59 | 95.83 | 3.53 | 23.73 | 22.31 | 96.17 | 97.73 | 36.85 | 5.03 | 94.93 | 55.12 | 98.4 | 31.33 | 38.24 | 95.92 | 93.12 | 43.54 | 4.72 | 16.85 | 95.32 | 25.12 | 88.26 | 97.75 | 97 | 44.32 | 94.18 | 94.38 | 43.91 | 60.36 | 84.32 | 93.5 | 59.25 | 93.76 | 23.39 | 92.51 | 1.41 | 95.46 | 61.49 | 58.8 | 93.07 | 61.44 | 5.88 | 24.25 | 49.56 | 95.37 | 97.53 | 88.46 | 93.83 | 48.77 | 7.57 | 93.02 | 96.14 | 38.88 | 95.5 | 81.41 | 98.53 | 50.23 | 43.49 | 23.77 | 5.39 | 93.47 | 34.19 | 96.95 | 93.02 | 96.43 | 92.92 | 96.62 | 97.08 | 97 | 98.57 | 94.12 | 95.45 | 22.8 | 16.02 | 73.6 | 10.89 | 79.73 | 17.67 | 95.99 | 14.91 | 96.17 | 34.21 | 48.35 | 92.67 | 95.12 | 23.19 | 97.23 | 7.42 | 78.25 | 6.53 | 30.73 | 77.58 | 95.8 | |
87 | 88.91 | 0.44 | 0.95 | 23.7 | 0.65 | 30.98 | 0.48 | 0.68 | 0.22 | 55.3 | 1.03 | 5.83 | 1.66 | 0 | 5.62 | 12.23 | 5.84 | 1.35 | 48.56 | 46.97 | 9.79 | 6 | 24.21 | 2.26 | 4.03 | 9.53 | 9.17 | 34.63 | 89.31 | 9.68 | 4.66 | 0.77 | 26.88 | 5.19 | 9.46 | 21.59 | 5.66 | 79.71 | 28.29 | 2.34 | 3.55 | 56.25 | 24.25 | 0.57 | 0.12 | 10.29 | 9.52 | 6.22 | 0.81 | 41.11 | 54 | 75.47 | 13.02 | 8.98 | 67.23 | 8.54 | 0.99 | 1.85 | 1.37 | 0.67 | 0.56 | 1.73 | 9.23 | 5.38 | 21.3 | 40.48 | 5.38 | 6.83 | 0.45 | 0.01 | 16.44 | 0.33 | 0.4 | 2.48 | 34.66 | 42.72 | 24.08 | 34.17 | 55.01 | 29.15 | 0.2 | 6.99 | 0.9 | 30.8 | 12.81 | 73.45 | 54.86 | 2.43 | 8.35 | 9.3 | 78.87 | 11.74 | 5.83 | 35.41 | 28.18 | 7.53 | 0.36 | 1.01 | 1.1 | 12.4 | 1.58 | 4.95 | 6.45 | 37.82 | 0.67 | 1.88 | 0 | 4.79 | 7.03 | 9.68 | 1.28 | 10.64 | 0.57 | 0.88 | 14.67 | |
95.04 | 94.96 | 8.33 | 1.3 | 41.84 | 0.03 | 37.87 | 0.61 | 0.74 | 0.42 | 65.41 | 1.46 | 8.79 | 5.76 | 0.01 | 5.92 | 16.12 | 6.12 | 9.06 | 57.4 | 57.68 | 12.56 | 9.47 | 27.13 | 1.82 | 3.87 | 14.41 | 6.69 | 54.87 | 93.72 | 14.74 | 5.84 | 0.6 | 30.8 | 5.39 | 11.9 | 28.08 | 6.81 | 85.29 | 38.68 | 2.96 | 3.74 | 70 | 30.49 | 0.87 | 0.1 | 17.43 | 14.69 | 7.28 | 0.77 | 46.65 | 59.43 | 82.71 | 37.26 | 11.21 | 79.77 | 7.81 | 0.91 | 2.23 | 1.48 | 1.77 | 0.38 | 1.96 | 12.11 | 6.13 | 27.84 | 45.89 | 5.94 | 8.11 | 0.59 | 0.03 | 21.7 | 0.68 | 5.92 | 2.39 | 45.04 | 64.75 | 36.74 | 54.77 | 57.12 | 34.39 | 2.04 | 8.34 | 0.87 | 38.06 | 28.35 | 83.61 | 65.27 | 30.42 | 13.19 | 13.49 | 89.18 | 14.66 | 13.24 | 60.67 | 34.76 | 8.07 | 0.36 | 1.46 | 0.67 | 25.22 | 1.58 | 4.99 | 7.72 | 38.49 | 0.87 | 9.12 | 0 | 5.48 | 8.45 | 13.75 | 1.44 | 9.15 | 0.28 | 0.98 | 35.71 | |
1.09 | 0.02 | 0 | 0 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
75.15 | 0.42 | 0.01 | 0.32 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
54 | 97.06 | 45.3 | 97.96 | 16.62 | 0.03 | 28.76 | 85.37 | 27.75 | 70.66 | 71.13 | 35.01 | 6.32 | 8.03 | 75.98 | 4.92 | 13.65 | 4.67 | 20.09 | 88.31 | 64.63 | 6.64 | 9.55 | 23.26 | 91.45 | 2.83 | 10.03 | 6.97 | 23.52 | 70.1 | 8.78 | 3.41 | 5.34 | 26.2 | 4.76 | 53.38 | 12.61 | 3.41 | 91.44 | 24.62 | 2.09 | 3.26 | 79.86 | 21.03 | 1.69 | 85.23 | 12.79 | 9.68 | 5.07 | 0.5 | 43.91 | 59.59 | 73.67 | 88.04 | 6.29 | 65.04 | 15.02 | 71.36 | 1.69 | 0.42 | 3.32 | 0.37 | 22.39 | 8.26 | 5.17 | 28.76 | 44.85 | 4.49 | 6.55 | 83.3 | 45.53 | 36.14 | 1.56 | 10.47 | 2.85 | 23.92 | 29.74 | 16.28 | 21.07 | 52.23 | 40.17 | 5.79 | 5.85 | 12.13 | 31.94 | 14.09 | 92.62 | 27.23 | 59.84 | 9.98 | 10.14 | 94.48 | 10.38 | 11.69 | 19.53 | 16.89 | 16.74 | 72.76 | 3.59 | 64.62 | 10.7 | 2.22 | 5.48 | 6.15 | 27.82 | 1.27 | 22.06 | 70.1 | 4.71 | 94.2 | 10.38 | 79.58 | 5.51 | 0.16 | 77.03 | 79.95 | |
99.13 | 97.59 | 97.2 | 98.3 | 86.91 | 74.93 | 29.07 | 82.59 | 26.74 | 66.79 | 75.31 | 68.39 | 84.71 | 86.7 | 81.05 | 23.58 | 88.86 | 5.44 | 88.63 | 84.09 | 60.54 | 45.46 | 88.88 | 16.95 | 93.35 | 4.38 | 24.56 | 65.22 | 91.4 | 97.07 | 34.33 | 5.13 | 89.96 | 92.07 | 70.51 | 56.16 | 64.72 | 86.15 | 92.76 | 50.88 | 43.08 | 58.36 | 82.79 | 43.53 | 74.14 | 93 | 92.5 | 40.35 | 84.32 | 85.91 | 74.39 | 72.43 | 86.11 | 90.26 | 76.9 | 90.61 | 61.25 | 90.3 | 21.98 | 77.83 | 75.56 | 47.26 | 83.37 | 52.96 | 6.2 | 39.58 | 52.85 | 75.53 | 76.66 | 96.72 | 86.62 | 52.39 | 5.52 | 73.76 | 78.37 | 53.86 | 93.2 | 82.56 | 95.9 | 66.83 | 35.79 | 16 | 6.92 | 87.08 | 44.61 | 94.82 | 92.74 | 91.27 | 91.78 | 86.4 | 81.93 | 96.97 | 90.06 | 89.08 | 91.33 | 42.33 | 66.81 | 85.12 | 66.92 | 88.49 | 83.78 | 94.4 | 19.66 | 92.67 | 34.44 | 63.08 | 88.29 | 86.2 | 62.63 | 94.68 | 47.18 | 78.65 | 73.24 | 63.2 | 80.66 | 92.45 | |
97.86 | 92.66 | 93.5 | 88.79 | 85.67 | 76.13 | 42.23 | 72.55 | 22.43 | 55.14 | 71.67 | 74.27 | 80.14 | 84.68 | 77.76 | 16.92 | 83.24 | 8.24 | 83.81 | 79.75 | 57.77 | 42.01 | 78.83 | 27.83 | 88.89 | 6.02 | 23.99 | 65.32 | 84.39 | 96.58 | 31.64 | 7.68 | 84.08 | 90.5 | 55.31 | 54.47 | 58.87 | 68.56 | 89.93 | 51.03 | 39.42 | 59.59 | 81.93 | 36.45 | 67.92 | 93.25 | 86.87 | 37.02 | 71.84 | 82.29 | 70.86 | 71.73 | 85.6 | 87.81 | 62.16 | 87.56 | 50.66 | 83.7 | 17.83 | 76.84 | 73.03 | 47.99 | 74.16 | 39.67 | 8.27 | 39.95 | 52.73 | 61.52 | 60.67 | 94.78 | 86.79 | 49.95 | 6.08 | 59.26 | 78.22 | 53.26 | 90.3 | 69.48 | 87.8 | 68.56 | 42.84 | 15.13 | 6.97 | 84 | 42.15 | 85.91 | 89.25 | 83.67 | 87.96 | 79.96 | 72.85 | 91.1 | 88.56 | 80.33 | 84.97 | 44.3 | 66.74 | 81.39 | 63.38 | 85.78 | 79.26 | 89.36 | 18.41 | 86.78 | 36.2 | 59.33 | 81.62 | 84.71 | 58 | 87.78 | 40.86 | 69.05 | 62.84 | 66.83 | 69.69 | 90 | |
99.38 | 98.11 | 97.52 | 99.2 | 90.26 | 80.69 | 40.18 | 85.47 | 41.56 | 74.73 | 81.76 | 72.27 | 87.61 | 91.2 | 83.02 | 38.89 | 92.86 | 11.1 | 92.93 | 91.03 | 69.15 | 55.31 | 94.89 | 27.21 | 95.28 | 6.28 | 36.98 | 76.21 | 95.08 | 99.07 | 48.44 | 7 | 93.88 | 96.01 | 85.03 | 77.82 | 72.62 | 95.44 | 93.42 | 63.43 | 59.01 | 71.48 | 93.34 | 51.65 | 86.52 | 94.48 | 96.15 | 58.7 | 94.01 | 90.92 | 83.63 | 79.15 | 93.61 | 92.9 | 91.96 | 93.29 | 75.46 | 95.28 | 36.54 | 84.09 | 79.44 | 60.02 | 90.65 | 66.83 | 7.91 | 53.3 | 63.02 | 88.48 | 89.83 | 97.7 | 88.58 | 63.42 | 6.79 | 85.5 | 87.53 | 69.52 | 96.63 | 91.4 | 97.2 | 71.56 | 54.91 | 39.8 | 9.28 | 92.14 | 59.87 | 96.6 | 93.63 | 94.87 | 92.32 | 93.13 | 89.65 | 97.1 | 94.7 | 93.1 | 95.3 | 56.83 | 71.61 | 88.23 | 73.65 | 91.34 | 92 | 95.38 | 33.15 | 96.27 | 53.16 | 72.08 | 93.32 | 89.21 | 72.35 | 97 | 62.26 | 86.23 | 80.87 | 76.33 | 88.71 | 94.53 |
Classification Leaderboard ❤️
Model | AmazonCounterfactualClassification (en) | AmazonPolarityClassification | AmazonReviewsClassification (en) | Banking77Classification | EmotionClassification | ImdbClassification | MTOPDomainClassification (en) | MTOPIntentClassification (en) | MassiveIntentClassification (en) | MassiveScenarioClassification (en) | ToxicConversationsClassification | TweetSentimentExtractionClassification |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
76.84 | 61.01 | 28.71 | 57.76 | 24.83 | 57.58 | 75.36 | 49.47 | 47.91 | 55.92 | 54.05 | 48.73 | |
75.93 | 68.95 | 35.8 | 69.85 | 37.22 | 62.04 | 86.06 | 63.03 | 61.46 | 66.41 | 66.9 | 58.82 | |
65.28 | 62.98 | 30.79 | 80.4 | 41.17 | 59.76 | 91.9 | 62.84 | 67.15 | 74.58 | 67.47 | 54.25 | |
64.15 | 62.58 | 31.79 | 79.75 | 38.43 | 60.66 | 91.56 | 62.18 | 67.4 | 75.76 | 66.99 | 55.41 | |
65.27 | 67.13 | 31.92 | 81.86 | 39.72 | 70.72 | 92.08 | 70.21 | 69.57 | 76.01 | 60.86 | 55.46 | |
58.7 | 57.77 | 26.26 | 66.66 | 24.82 | 56.35 | 74.53 | 50.05 | 51.73 | 58.58 | 57.44 | 45.52 | |
74.25 | 71.33 | 33.56 | 63.41 | 35.28 | 65.35 | 82.63 | 68.14 | 59.88 | 64.28 | 70 | 51.81 | |
72.19 | 68.63 | 37.42 | 80.02 | 44.77 | 67.04 | 93.18 | 69.31 | 67.78 | 76 | 67.77 | 56.1 | |
56.91 | 60.32 | 29.67 | 67.69 | 36.93 | 62.57 | 79.11 | 55.85 | 56.19 | 66.03 | 65.4 | 50.8 | |
69.33 | 67.82 | 38.48 | 79.26 | 42.2 | 65.99 | 92.42 | 62.44 | 67.05 | 75.4 | 66.6 | 56.02 | |
70.03 | 73.92 | 37.21 | 81.21 | 46.33 | 70.86 | 94.01 | 63.86 | 70.06 | 75.49 | 68.65 | 54.09 | |
68.6 | 74.58 | 38.2 | 82.22 | 45.54 | 68.15 | 93.6 | 65.93 | 70.23 | 75.94 | 67.56 | 54.77 | |
67.3 | 75.05 | 37.3 | 82.32 | 43.19 | 70.8 | 93.84 | 67.71 | 70.61 | 77.77 | 68.48 | 54.54 | |
60.54 | 59.59 | 31.01 | 67.05 | 33.18 | 63.98 | 78.57 | 57.07 | 57.21 | 66.11 | 67.76 | 49.68 | |
64.06 | 66.88 | 34.85 | 82.35 | 41.91 | 60.17 | 91.34 | 71.07 | 70.4 | 73.73 | 64.01 | 55.74 | |
71.57 | 69.21 | 35.11 | 79.77 | 42.37 | 60.46 | 87.06 | 65.52 | 66.84 | 71.51 | 66.07 | 56.12 | |
75.81 | 76.41 | 38.51 | 81.07 | 45.83 | 64.57 | 89.24 | 68.69 | 69.32 | 75.35 | 71.02 | 59.03 | |
75.82 | 85.12 | 44.94 | 76.48 | 51.35 | 77.34 | 90.34 | 63.32 | 69.74 | 72.32 | 68.2 | 62.71 | |
75.51 | 92.87 | 47.12 | 78.46 | 51.74 | 87.01 | 90.99 | 64.98 | 71.78 | 73.16 | 71.73 | 62.33 | |
76.01 | 93.17 | 48.18 | 80.88 | 51.95 | 87.54 | 90.73 | 68.15 | 72.09 | 73.26 | 70.95 | 61.21 | |
77.07 | 92.79 | 48.93 | 82.31 | 48.57 | 90.23 | 92.49 | 68.33 | 73.44 | 74.82 | 70.04 | 62.01 | |
75.75 | 82.47 | 39.6 | 75.76 | 44.81 | 73.53 | 84.29 | 63.14 | 65.95 | 70.78 | 72.04 | 59.73 | |
75.94 | 86.72 | 44.78 | 80.66 | 48.74 | 77.98 | 92.13 | 64.68 | 70.15 | 75.33 | 72.29 | 61.81 | |
76.4 | 92.83 | 47.45 | 68.04 | 50.33 | 89.38 | 89.89 | 64.8 | 65.17 | 67.67 | 70 | 63.35 | |
67.09 | 74.48 | 33.85 | 73.55 | 42.22 | 69.63 | 81.71 | 59.23 | 59.84 | 66.25 | 68.82 | 53.36 | |
65.21 | 73.21 | 34.96 | 82.06 | 46.39 | 64.05 | 92.08 | 71.19 | 68.65 | 76.04 | 68.73 | 55.67 | |
61.24 | 65.4 | 31.17 | 77.7 | 39.08 | 58.67 | 86.96 | 62.25 | 61.41 | 69.74 | 62.66 | 52.41 | |
65.88 | 74.94 | 35.1 | 74.68 | 42.23 | 62.9 | 81.52 | 58.24 | 58.08 | 66.34 | 62.79 | 54.82 | |
67.57 | 71.44 | 35.75 | 83.22 | 49.21 | 63.53 | 92.56 | 71.85 | 69.01 | 75.9 | 68.84 | 56.69 | |
69.22 | 71.26 | 39.19 | 84.49 | 49.66 | 66.64 | 93.47 | 72.42 | 70.39 | 76.28 | 67.71 | 56.85 | |
74.07 | 82.31 | 41.58 | 81.74 | 49.92 | 74.33 | 89.64 | 70.68 | 70 | 75.03 | 69.93 | 62.44 | |
68.06 | 68.97 | 33.86 | 84.33 | 44.87 | 61.77 | 93.68 | 71.34 | 69.67 | 75.34 | 66.55 | 55.85 | |
76.22 | 87.53 | 42.61 | 81.87 | 46.86 | 75.55 | 92.05 | 73.24 | 72.22 | 75.78 | 72.76 | 63.31 | |
88.13 | 91.53 | 47.86 | 78.51 | 52.73 | 88.32 | 93.89 | 67.98 | 68.9 | 73.35 | 71.05 | 64.13 | |
86.21 | 88.36 | 44.64 | 77.04 | 51.76 | 81.17 | 93.72 | 70.26 | 67.48 | 72.59 | 71.82 | 63.31 | |
85.09 | 86.54 | 42.96 | 82.66 | 53.24 | 79.79 | 95.07 | 72.26 | 71.48 | 76.47 | 70.33 | 61.58 | |
79.72 | 87.96 | 42.65 | 83.33 | 49.44 | 75.96 | 93.21 | 74.77 | 72.25 | 76.76 | 74.12 | 61.38 | |
77.69 | 90.05 | 43.02 | 84.14 | 48.05 | 82.11 | 93.86 | 76.4 | 73.22 | 77.39 | 70.56 | 61.21 | |
72.76 | 55.74 | 60.23 | 20.12 | 53.83 | 70.81 | 58.95 | 48.85 | 48.12 | 55.47 | 41.45 | ||
72.63 | 85.12 | 37.79 | 84.7 | 45.63 | 74.73 | 93.06 | 78.19 | 73.87 | 77.54 | 67.67 | 58.44 | |
65.03 | 67.13 | 31.44 | 81.68 | 42.21 | 71.17 | 91.88 | 68.25 | 69.79 | 75.68 | 66.09 | 55.03 | |
70.81 | 67.05 | 35.85 | 74.67 | 42.31 | 63.69 | 92.48 | 70.27 | 69.05 | 75.8 | 68.22 | 59.19 | |
69.84 | 65.24 | 33.95 | 72.79 | 35.6 | 66.32 | 90.4 | 62.28 | 66.12 | 73.74 | 67.56 | 57.24 | |
70.67 | 67.73 | 32.62 | 74.12 | 38.64 | 68.43 | 90.12 | 65 | 67.23 | 72.79 | 68.99 | 57.01 | |
76.19 | 69.63 | 35.53 | 78.13 | 45.48 | 64.06 | 92.94 | 74.43 | 71.69 | 77.2 | 70.17 | 59.31 | |
79.06 | 70.19 | 34.29 | 75.89 | 40.26 | 61.14 | 87.22 | 69.45 | 65.6 | 70.37 | 70.26 | 54.49 | |
77.6 | 91.27 | 45.88 | 81.64 | 47.06 | 86 | 92.7 | 72.56 | 71.62 | 76.36 | 71.1 | 61.46 | |
77.78 | 92.81 | 46.71 | 83.53 | 46.95 | 86.15 | 93.69 | 75.31 | 73.04 | 77.65 | 72.11 | 60.39 | |
79.22 | 93.75 | 48.61 | 84.55 | 49.45 | 91.69 | 94.62 | 77.14 | 73.84 | 78.11 | 70.9 | 60.94 | |
78.97 | 90.64 | 44.55 | 82.74 | 45.18 | 85.46 | 93.13 | 75.27 | 72.11 | 77.08 | 69.78 | 61.28 | |
84.82 | 76.88 | 36.72 | 41.93 | 87.95 | 78.43 | 65.91 | 67.62 | 56.28 | ||||
57.49 | 30.59 | 73.42 | 33.62 | 56.17 | 87.07 | 61.96 | 62.96 | 71.47 | 49.34 | |||
70.97 | 66.1 | 33.13 | 78.08 | 43.35 | 59.35 | 81.05 | 62.79 | 63.83 | 66.96 | 65.97 | 55.22 | |
64.87 | 65.17 | 31.02 | 74.12 | 36.71 | 66.9 | 89.13 | 62.62 | 61.95 | 70.2 | 63.57 | 51.04 | |
73.79 | 88.7 | 44.7 | 79.42 | 42.45 | 80.82 | 91.07 | 71.08 | 70.3 | 74.48 | 69.39 | 62.62 | |
79.06 | 93.49 | 47.56 | 84.73 | 46.5 | 90.23 | 93.67 | 77.9 | 73.76 | 77.51 | 71.32 | 61.98 | |
64.58 | 61.93 | 28.5 | 74.49 | 34.39 | 58.27 | 89.86 | 59.04 | 65 | 72.15 | 59.69 | 53.54 | |
66.58 | 65.1 | 30.63 | 84.11 | 41.33 | 65.75 | 91.72 | 74.95 | 71.43 | 77.05 | 65.53 | 56.47 |
Classification Multilingual Leaderboard 💜💚💙
Model | AmazonCounterfactualClassification (de) | AmazonCounterfactualClassification (en) | AmazonCounterfactualClassification (en-ext) | AmazonCounterfactualClassification (ja) | AmazonPolarityClassification | AmazonReviewsClassification (de) | AmazonReviewsClassification (en) | AmazonReviewsClassification (es) | AmazonReviewsClassification (fr) | AmazonReviewsClassification (ja) | AmazonReviewsClassification (zh) | Banking77Classification | EmotionClassification | ImdbClassification | MTOPDomainClassification (de) | MTOPDomainClassification (en) | MTOPDomainClassification (es) | MTOPDomainClassification (fr) | MTOPDomainClassification (hi) | MTOPDomainClassification (th) | MTOPIntentClassification (de) | MTOPIntentClassification (en) | MTOPIntentClassification (es) | MTOPIntentClassification (fr) | MTOPIntentClassification (hi) | MTOPIntentClassification (th) | MassiveIntentClassification (af) | MassiveIntentClassification (am) | MassiveIntentClassification (ar) | MassiveIntentClassification (az) | MassiveIntentClassification (bn) | MassiveIntentClassification (cy) | MassiveIntentClassification (da) | MassiveIntentClassification (de) | MassiveIntentClassification (el) | MassiveIntentClassification (en) | MassiveIntentClassification (es) | MassiveIntentClassification (fa) | MassiveIntentClassification (fi) | MassiveIntentClassification (fr) | MassiveIntentClassification (he) | MassiveIntentClassification (hi) | MassiveIntentClassification (hu) | MassiveIntentClassification (hy) | MassiveIntentClassification (id) | MassiveIntentClassification (is) | MassiveIntentClassification (it) | MassiveIntentClassification (ja) | MassiveIntentClassification (jv) | MassiveIntentClassification (ka) | MassiveIntentClassification (km) | MassiveIntentClassification (kn) | MassiveIntentClassification (ko) | MassiveIntentClassification (lv) | MassiveIntentClassification (ml) | MassiveIntentClassification (mn) | MassiveIntentClassification (ms) | MassiveIntentClassification (my) | MassiveIntentClassification (nb) | MassiveIntentClassification (nl) | MassiveIntentClassification (pl) | MassiveIntentClassification (pt) | MassiveIntentClassification (ro) | MassiveIntentClassification (ru) | MassiveIntentClassification (sl) | MassiveIntentClassification (sq) | MassiveIntentClassification (sv) | MassiveIntentClassification (sw) | MassiveIntentClassification (ta) | MassiveIntentClassification (te) | MassiveIntentClassification (th) | MassiveIntentClassification (tl) | MassiveIntentClassification (tr) | MassiveIntentClassification (ur) | MassiveIntentClassification (vi) | MassiveIntentClassification (zh-CN) | MassiveIntentClassification (zh-TW) | MassiveScenarioClassification (af) | MassiveScenarioClassification (am) | MassiveScenarioClassification (ar) | MassiveScenarioClassification (az) | MassiveScenarioClassification (bn) | MassiveScenarioClassification (cy) | MassiveScenarioClassification (da) | MassiveScenarioClassification (de) | MassiveScenarioClassification (el) | MassiveScenarioClassification (en) | MassiveScenarioClassification (es) | MassiveScenarioClassification (fa) | MassiveScenarioClassification (fi) | MassiveScenarioClassification (fr) | MassiveScenarioClassification (he) | MassiveScenarioClassification (hi) | MassiveScenarioClassification (hu) | MassiveScenarioClassification (hy) | MassiveScenarioClassification (id) | MassiveScenarioClassification (is) | MassiveScenarioClassification (it) | MassiveScenarioClassification (ja) | MassiveScenarioClassification (jv) | MassiveScenarioClassification (ka) | MassiveScenarioClassification (km) | MassiveScenarioClassification (kn) | MassiveScenarioClassification (ko) | MassiveScenarioClassification (lv) | MassiveScenarioClassification (ml) | MassiveScenarioClassification (mn) | MassiveScenarioClassification (ms) | MassiveScenarioClassification (my) | MassiveScenarioClassification (nb) | MassiveScenarioClassification (nl) | MassiveScenarioClassification (pl) | MassiveScenarioClassification (pt) | MassiveScenarioClassification (ro) | MassiveScenarioClassification (ru) | MassiveScenarioClassification (sl) | MassiveScenarioClassification (sq) | MassiveScenarioClassification (sv) | MassiveScenarioClassification (sw) | MassiveScenarioClassification (ta) | MassiveScenarioClassification (te) | MassiveScenarioClassification (th) | MassiveScenarioClassification (tl) | MassiveScenarioClassification (tr) | MassiveScenarioClassification (ur) | MassiveScenarioClassification (vi) | MassiveScenarioClassification (zh-CN) | MassiveScenarioClassification (zh-TW) | ToxicConversationsClassification | TweetSentimentExtractionClassification |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
67.82 | 76.84 | 76.17 | 68.76 | 61.01 | 31.07 | 28.71 | 32.72 | 31.12 | 28.94 | 30.89 | 57.76 | 24.83 | 57.58 | 74.08 | 75.36 | 73.47 | 72.26 | 72.95 | 72.68 | 51.62 | 49.47 | 52.75 | 50.12 | 45.55 | 50.07 | 38.01 | 12.7 | 37.16 | 19.98 | 42.51 | 17.33 | 45.61 | 44.79 | 46.71 | 47.91 | 45.44 | 45.01 | 45.94 | 46.13 | 42.55 | 40.2 | 42.77 | 28.07 | 45.81 | 39.86 | 48.25 | 45.3 | 24.3 | 22.7 | 22.48 | 4.32 | 44.26 | 39.75 | 41.33 | 16.2 | 43.23 | 25.37 | 37.74 | 45 | 44.99 | 48.55 | 44.3 | 44.29 | 44.72 | 46.12 | 45.95 | 31.89 | 29.63 | 36.03 | 43.39 | 29.73 | 43.93 | 26.11 | 44.33 | 40.62 | 32.93 | 47.1 | 17.7 | 45.21 | 28.21 | 50.52 | 22.58 | 54.87 | 54.34 | 55.47 | 55.92 | 52.77 | 52.5 | 52.63 | 54.32 | 52.41 | 47.37 | 53.43 | 33.57 | 54.38 | 49.78 | 54.84 | 54.12 | 32.71 | 26.92 | 27.23 | 10.06 | 52.01 | 44.82 | 49.1 | 21.51 | 53.6 | 29.72 | 43.9 | 53.33 | 52.92 | 53.41 | 50.48 | 51.84 | 51.29 | 55.65 | 54.64 | 42.04 | 36.72 | 42.08 | 52.15 | 37.34 | 52.56 | 32.6 | 50.97 | 50.22 | 42.32 | 54.05 | 48.73 | |
73.17 | 75.93 | 76.09 | 76.42 | 68.95 | 39.92 | 35.8 | 39.39 | 38.52 | 36.44 | 36.45 | 69.85 | 37.22 | 62.04 | 86.95 | 86.06 | 84.07 | 84.14 | 85.11 | 81.24 | 63.42 | 63.03 | 64.44 | 62.01 | 62.58 | 64.61 | 56.12 | 55.71 | 50.86 | 58.97 | 58.22 | 50.16 | 58.25 | 56.21 | 57.03 | 61.46 | 58.32 | 62.33 | 60.12 | 60.47 | 56.55 | 59.4 | 59.52 | 56.2 | 61.12 | 54.9 | 59.83 | 63.11 | 50.98 | 48.35 | 48.55 | 56.24 | 60.99 | 57.1 | 57.91 | 58.5 | 58.6 | 57.35 | 57.91 | 59.37 | 59.71 | 60.16 | 57.92 | 60.67 | 59.37 | 58.03 | 59.66 | 51.62 | 55.04 | 58.32 | 56.58 | 55.28 | 60.91 | 56.7 | 56.67 | 63.86 | 59.51 | 63.39 | 62.02 | 57.72 | 63.48 | 61.84 | 56.13 | 65.24 | 62.39 | 64.58 | 66.41 | 63.61 | 67.46 | 64.58 | 65.1 | 63.53 | 64.4 | 65.82 | 61.25 | 65.84 | 61.94 | 64.09 | 67.72 | 58.29 | 53.38 | 56.18 | 61.74 | 67.26 | 61.87 | 62.26 | 62.6 | 65.63 | 62.94 | 64.29 | 65.16 | 64.56 | 63.28 | 62.41 | 65.25 | 64.25 | 64.54 | 66.01 | 58.36 | 59.08 | 64.13 | 64.34 | 60.23 | 65.43 | 61.52 | 61.05 | 70.85 | 67.08 | 66.9 | 58.82 | |
57.1 | 65.28 | 67.24 | 59.91 | 62.98 | 25.91 | 30.79 | 27.63 | 27.54 | 23.57 | 22.99 | 80.4 | 41.17 | 59.76 | 72.04 | 91.9 | 72.99 | 75.59 | 40.36 | 17.1 | 43.41 | 62.84 | 41.88 | 38.94 | 17.75 | 5.63 | 38.94 | 2.45 | 20.94 | 34.25 | 13.67 | 35.71 | 44.43 | 44.17 | 28.7 | 67.15 | 40.91 | 23.52 | 39.27 | 44.82 | 23.65 | 17.98 | 38 | 8.69 | 39.66 | 35.14 | 43.17 | 30.94 | 36.69 | 9.17 | 4.99 | 3.08 | 19.97 | 38.61 | 2.85 | 23.25 | 36.21 | 4.38 | 41.91 | 41.85 | 37.63 | 45.12 | 41.71 | 26.33 | 38.52 | 41.62 | 40.42 | 35.28 | 13.1 | 2.56 | 10.54 | 38.56 | 35.9 | 16.18 | 37.38 | 23.74 | 22.39 | 45.71 | 7.41 | 27.62 | 39.58 | 18.98 | 41.4 | 49.47 | 52.07 | 35.51 | 74.58 | 50.74 | 29 | 45.8 | 53.76 | 25.68 | 23.02 | 44.09 | 14.83 | 44.35 | 43.08 | 51.71 | 36.75 | 44.57 | 14.84 | 9.75 | 8.32 | 25.72 | 42.75 | 7.25 | 29.03 | 44.65 | 10.07 | 47.36 | 49.15 | 44.72 | 53 | 49.97 | 28.75 | 42.26 | 49.14 | 46.83 | 43.18 | 19.38 | 7.74 | 18.32 | 48.31 | 41.79 | 24.46 | 40.94 | 33.18 | 31.16 | 67.47 | 54.25 | |
64.15 | 62.58 | 31.79 | 79.75 | 38.43 | 60.66 | 91.56 | 62.18 | 67.4 | 75.76 | 66.99 | 55.41 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
65.27 | 67.13 | 31.92 | 81.86 | 39.72 | 70.72 | 92.08 | 70.21 | 69.57 | 76.01 | 60.86 | 55.46 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
54.46 | 58.7 | 59.28 | 43.87 | 57.77 | 24.08 | 26.26 | 23.88 | 23.31 | 20.25 | 20.49 | 66.66 | 24.82 | 56.35 | 48.55 | 74.53 | 58.39 | 54.61 | 21.22 | 14.98 | 35.55 | 50.05 | 36.72 | 34.71 | 4.44 | 4.67 | 33.68 | 2.94 | 10.04 | 30.74 | 3.02 | 33.94 | 38.47 | 36.06 | 27.7 | 51.73 | 35.6 | 17.97 | 35.53 | 38.41 | 2.69 | 3.43 | 34.05 | 3.11 | 40.02 | 32.63 | 39.28 | 4.95 | 34.95 | 2.57 | 4.73 | 3.54 | 2.68 | 37.91 | 2.88 | 16.94 | 36.6 | 3.96 | 34.75 | 33.95 | 35.77 | 43.05 | 36.2 | 25.3 | 35.9 | 36.6 | 36 | 34.81 | 3.11 | 2.53 | 4.38 | 35.51 | 32.02 | 9.61 | 37.07 | 2.81 | 4.79 | 36.17 | 7.64 | 15.26 | 30.73 | 7.15 | 34.73 | 39.93 | 38.62 | 27.18 | 58.58 | 39.44 | 21.43 | 33.21 | 40.26 | 7.42 | 8.06 | 34.54 | 8.61 | 40.04 | 33.57 | 40.1 | 9.96 | 36.11 | 7.13 | 9.66 | 7.55 | 7.27 | 37.03 | 7.22 | 21.53 | 37.57 | 9.54 | 35.71 | 34.62 | 36.87 | 44.68 | 37.29 | 28.16 | 37.95 | 37.82 | 35.35 | 35.37 | 7.19 | 7.29 | 9.47 | 37.31 | 34.57 | 16.17 | 35.91 | 9.19 | 10.19 | 57.44 | 45.52 | |
74.25 | 71.33 | 33.56 | 63.41 | 35.28 | 65.35 | 82.63 | 68.14 | 59.88 | 64.28 | 70 | 51.81 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
72.19 | 68.63 | 37.42 | 80.02 | 44.77 | 67.04 | 93.18 | 69.31 | 67.78 | 76 | 67.77 | 56.1 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
56.91 | 60.32 | 29.67 | 67.69 | 36.93 | 62.57 | 79.11 | 55.85 | 56.19 | 66.03 | 65.4 | 50.8 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
69.33 | 67.82 | 38.48 | 79.26 | 42.2 | 65.99 | 92.42 | 62.44 | 67.05 | 75.4 | 66.6 | 56.02 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
59.38 | 70.03 | 69.86 | 45.87 | 73.92 | 33.06 | 37.21 | 34 | 33.48 | 21.78 | 21.83 | 81.21 | 46.33 | 70.86 | 81.91 | 94.01 | 84.7 | 82.48 | 22.11 | 16.36 | 52.13 | 63.86 | 52.62 | 46.39 | 3.9 | 5.38 | 41.02 | 2.34 | 4.87 | 34.92 | 2.52 | 35.87 | 45.3 | 51.48 | 10 | 70.06 | 53.3 | 3.59 | 37.35 | 54.83 | 2.52 | 2.88 | 33.52 | 3.13 | 40.11 | 34.77 | 51.21 | 4.75 | 35.6 | 2.71 | 5.48 | 2.44 | 2.59 | 38.15 | 2.67 | 18.47 | 35.58 | 4.35 | 43.78 | 45.96 | 39.08 | 52.27 | 46.39 | 16.82 | 37.3 | 41.73 | 43.51 | 35.97 | 1.52 | 2.57 | 3.94 | 41.03 | 33.75 | 2.57 | 25.23 | 2.41 | 4.64 | 51.48 | 7.74 | 12.03 | 41.77 | 8.07 | 43.67 | 54.88 | 63.63 | 16.83 | 75.49 | 61.48 | 6.48 | 43.54 | 64.06 | 8.03 | 7.5 | 42.59 | 9.22 | 48.67 | 43.87 | 59.83 | 5.62 | 42.18 | 7.52 | 9.55 | 8.34 | 6.11 | 43.35 | 7.28 | 23.94 | 45.18 | 9.33 | 52.71 | 57.02 | 46.79 | 59.45 | 56.8 | 25.85 | 42.51 | 50.41 | 54.16 | 43.02 | 7.21 | 6.9 | 8.7 | 51.76 | 42.54 | 9.32 | 31.51 | 3.84 | 8.16 | 68.65 | 54.09 | |
59.79 | 68.6 | 69.03 | 50.59 | 74.58 | 35.06 | 38.2 | 37.18 | 35.48 | 22.24 | 21.89 | 82.22 | 45.54 | 68.15 | 85.42 | 93.6 | 88.2 | 85.05 | 21.74 | 15.87 | 55.75 | 65.93 | 57.73 | 51.07 | 3.19 | 5.55 | 42.6 | 2.12 | 4.64 | 35.05 | 2.84 | 36.19 | 48.42 | 55.49 | 10.14 | 70.23 | 56.72 | 3.54 | 37.13 | 57.67 | 2.56 | 3.24 | 34.22 | 3.01 | 46.54 | 34.77 | 54.13 | 4.27 | 36.97 | 2.72 | 5.35 | 3.17 | 2.64 | 36.32 | 3.18 | 22.85 | 42.87 | 4.04 | 45.87 | 49.53 | 42.64 | 57.03 | 49.95 | 36.58 | 39.44 | 41.78 | 47.95 | 35.85 | 2.32 | 2.2 | 3.74 | 43.12 | 35.24 | 3 | 30.01 | 1.72 | 3.35 | 52.54 | 6.3 | 11.96 | 40.17 | 8.29 | 42.24 | 57.28 | 68.09 | 16.66 | 75.94 | 64.32 | 6.9 | 43.96 | 66.72 | 7.51 | 7.82 | 42.16 | 9.33 | 53.54 | 42.84 | 62.44 | 7.29 | 43.13 | 7.63 | 9.08 | 8.1 | 6.35 | 40.24 | 7.65 | 27.98 | 52.41 | 9.21 | 54.44 | 60.35 | 49.97 | 62.78 | 59.62 | 43.44 | 44.79 | 50.84 | 58.21 | 44.63 | 7.95 | 7.5 | 8.79 | 53.54 | 42.47 | 9.58 | 34.68 | 5.21 | 8.77 | 67.56 | 54.77 | |
67.3 | 75.05 | 37.3 | 82.32 | 43.19 | 70.8 | 93.84 | 67.71 | 70.61 | 77.77 | 68.48 | 54.54 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
60.54 | 59.59 | 31.01 | 67.05 | 33.18 | 63.98 | 78.57 | 57.07 | 57.21 | 66.11 | 67.76 | 49.68 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
64.06 | 66.88 | 34.85 | 82.35 | 41.91 | 60.17 | 91.34 | 71.07 | 70.4 | 73.73 | 64.01 | 55.74 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
68.35 | 71.57 | 69.99 | 63.45 | 69.21 | 35.91 | 35.11 | 37.49 | 35.3 | 33.24 | 35.26 | 79.77 | 42.37 | 60.46 | 79.2 | 87.06 | 83.04 | 78.63 | 81.36 | 79.99 | 54.23 | 65.52 | 60.28 | 54.05 | 59.9 | 61.96 | 45.88 | 36.75 | 45.14 | 47.42 | 35.34 | 26.12 | 57.73 | 50.71 | 58.7 | 66.84 | 59.66 | 61.02 | 57.54 | 60.25 | 52.51 | 58.37 | 60.41 | 51.6 | 59.85 | 30.83 | 59.61 | 60.89 | 32.37 | 43.03 | 40.04 | 40.98 | 50.3 | 54.68 | 42.41 | 51.77 | 54.76 | 52.01 | 55.5 | 59.51 | 59.43 | 61.27 | 58.39 | 59.04 | 57.36 | 56.59 | 59.43 | 29.57 | 36.77 | 40.72 | 58.97 | 33.67 | 59.9 | 52.8 | 56.61 | 61.99 | 58.77 | 53.64 | 41.89 | 51.74 | 52.06 | 41.17 | 31.72 | 66.87 | 57.4 | 66.14 | 71.51 | 65.04 | 65.86 | 63.75 | 66.06 | 59.2 | 65.21 | 66.56 | 56.11 | 66.16 | 37.52 | 65 | 66.5 | 38.6 | 50.66 | 46.96 | 45.73 | 55.66 | 59.8 | 47.69 | 57.07 | 61.71 | 59.1 | 64.25 | 65.52 | 65.04 | 65.79 | 64.17 | 65.24 | 64.01 | 64.31 | 67.14 | 34.86 | 42.62 | 46.46 | 67.01 | 37.37 | 66.55 | 60.43 | 60.72 | 67.44 | 65.7 | 66.07 | 56.12 | |
69.95 | 75.81 | 76.23 | 69.79 | 76.41 | 39.52 | 38.51 | 39.99 | 39 | 36.64 | 37.74 | 81.07 | 45.83 | 64.57 | 85.73 | 89.24 | 86.96 | 81.21 | 84.76 | 82.51 | 61.27 | 68.69 | 66.59 | 59.76 | 62.37 | 64.8 | 52.32 | 41.55 | 51.43 | 56.98 | 48.79 | 27.87 | 62.77 | 59.57 | 62.62 | 69.32 | 64.43 | 65.34 | 62.28 | 64.82 | 58.21 | 62.77 | 63.87 | 57.74 | 65.43 | 37.05 | 64.68 | 63.74 | 36.49 | 49.85 | 45.47 | 50.63 | 61.82 | 61.29 | 54.34 | 56.59 | 60.7 | 57.09 | 62.6 | 63.57 | 64.3 | 64.89 | 62.8 | 63.26 | 63.51 | 62.49 | 64.73 | 31.95 | 50.17 | 52.82 | 61.11 | 38.83 | 64.54 | 56.37 | 59.68 | 65.33 | 62.35 | 59.67 | 48.97 | 57.78 | 61.53 | 54.53 | 35.26 | 71 | 67.34 | 68.81 | 75.35 | 70.42 | 69.88 | 67.6 | 70.69 | 65.16 | 67.92 | 70.3 | 63.02 | 70.73 | 44.16 | 69.73 | 69.69 | 44.2 | 57.3 | 53.14 | 56.08 | 68.52 | 66.28 | 60.13 | 60.85 | 65.81 | 63.03 | 70.24 | 70.37 | 68.99 | 70.09 | 67.95 | 69.92 | 70.81 | 69.63 | 71.6 | 37.29 | 55.96 | 58.81 | 69.44 | 43.99 | 70.4 | 62.9 | 65.71 | 71.23 | 68.73 | 71.02 | 59.03 | |
69.98 | 75.82 | 76.81 | 46.05 | 85.12 | 37.9 | 44.94 | 37.33 | 37.35 | 22.29 | 21.53 | 76.48 | 51.35 | 77.34 | 76.98 | 90.34 | 73.61 | 75.03 | 21.4 | 16.21 | 44.43 | 63.32 | 42.03 | 43.85 | 3.8 | 5.21 | 34.32 | 2.38 | 4.53 | 31.76 | 2.58 | 28.94 | 38.82 | 45.23 | 10.05 | 69.74 | 45.32 | 3.58 | 33.52 | 51.13 | 2.63 | 2.68 | 32.31 | 3.33 | 35.5 | 29.82 | 45.59 | 3.67 | 31.15 | 2.77 | 5.66 | 2.59 | 2.34 | 33.97 | 2.55 | 14.7 | 33.12 | 4.42 | 38.53 | 37.96 | 34.41 | 43.35 | 42.69 | 14.82 | 34.54 | 38.54 | 35.98 | 32.14 | 1.41 | 2.5 | 3.71 | 36.04 | 33.77 | 2.99 | 22.62 | 1.12 | 4.63 | 44.45 | 7.51 | 12.32 | 38.41 | 8.45 | 35.04 | 48.36 | 59.12 | 17.68 | 72.32 | 55.61 | 6.86 | 41.34 | 59.92 | 7.86 | 7.63 | 41.31 | 9.23 | 44.64 | 39.63 | 54.58 | 4.96 | 40.73 | 7.51 | 8.73 | 7.99 | 6.03 | 36.42 | 6.96 | 19.85 | 43.18 | 9.46 | 46.6 | 50 | 42.3 | 52.24 | 53.7 | 20.69 | 39.79 | 50.16 | 46.69 | 40.48 | 7.47 | 6.87 | 8.26 | 48.94 | 41.83 | 9.77 | 30.01 | 4.17 | 7.91 | 68.2 | 62.71 | |
67.97 | 75.51 | 75.44 | 45.72 | 92.87 | 43.16 | 47.12 | 42.89 | 41.48 | 22.49 | 22.12 | 78.46 | 51.74 | 87.01 | 80.56 | 90.99 | 80.78 | 79.6 | 21.22 | 15.82 | 52.5 | 64.98 | 52.07 | 47.73 | 3.74 | 4.96 | 38.41 | 2.49 | 4.7 | 31.77 | 2.77 | 31.69 | 41.76 | 52.01 | 9.74 | 71.78 | 54.1 | 3.86 | 34.07 | 57.01 | 2.14 | 2.97 | 32.01 | 3.17 | 34.55 | 32 | 52.94 | 2.9 | 32.42 | 2.71 | 5.5 | 2.41 | 2.57 | 35.09 | 2.95 | 18.33 | 29.69 | 3.99 | 41.29 | 44.95 | 37.67 | 51.96 | 43.83 | 17.32 | 33.71 | 37.62 | 40.67 | 31.9 | 1.91 | 2.54 | 3.85 | 36.83 | 33 | 2.62 | 22.81 | 1.09 | 3.49 | 50.28 | 7.15 | 12.12 | 39.68 | 8.06 | 38.01 | 51.44 | 62.71 | 17.19 | 73.16 | 59.56 | 6.5 | 41.72 | 63.6 | 7.93 | 7.85 | 41.37 | 9.42 | 44.88 | 40.86 | 60.09 | 6.56 | 40.18 | 7.37 | 9.56 | 8.4 | 5.96 | 41.44 | 7.47 | 25.36 | 39.69 | 9.68 | 49.92 | 56.09 | 45.2 | 57.99 | 56 | 27.47 | 41.04 | 49.38 | 50.97 | 40.62 | 7.59 | 7.07 | 8.52 | 49.89 | 43.08 | 9.31 | 27.46 | 4.7 | 7.24 | 71.73 | 62.33 | |
67.01 | 76.01 | 77.29 | 45.61 | 93.17 | 44.05 | 48.18 | 45.01 | 43.52 | 22.23 | 21.88 | 80.88 | 51.95 | 87.54 | 83.28 | 90.73 | 85.32 | 85.14 | 20.85 | 15.62 | 54.65 | 68.15 | 57.38 | 54.39 | 3.28 | 5.08 | 40.17 | 2.18 | 4.18 | 30.02 | 2.6 | 29.15 | 47.69 | 57.43 | 9.96 | 72.09 | 57.97 | 3.6 | 34.02 | 60.99 | 2.51 | 3.02 | 31.66 | 3.32 | 41.53 | 30.25 | 56.57 | 3.5 | 31.67 | 2.79 | 5.43 | 2.79 | 2.67 | 34.25 | 2.98 | 20.99 | 37.43 | 4.02 | 45.91 | 50.51 | 43.95 | 57.95 | 49.37 | 33.46 | 36.33 | 37.65 | 46.35 | 30.6 | 1.79 | 2.26 | 4.02 | 38.92 | 32.05 | 2.7 | 21.47 | 0.59 | 3.24 | 50.81 | 6.95 | 12.32 | 38.79 | 8 | 33.91 | 55.79 | 65.33 | 16.89 | 73.26 | 62.52 | 6.08 | 43.34 | 66.42 | 7.55 | 7.44 | 40.85 | 9.25 | 51.92 | 40.09 | 62.94 | 7.9 | 41.33 | 7.76 | 9.19 | 8.36 | 6.13 | 40.7 | 6.98 | 27 | 46.9 | 9.55 | 53.43 | 59.65 | 49.87 | 62.18 | 58.22 | 40.73 | 43.66 | 49.25 | 57.17 | 40.55 | 7.46 | 7.03 | 8.52 | 51.74 | 43.01 | 9.61 | 28.91 | 5.86 | 7.14 | 70.95 | 61.21 | |
77.07 | 92.79 | 48.93 | 82.31 | 48.57 | 90.23 | 92.49 | 68.33 | 73.44 | 74.82 | 70.04 | 62.01 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
75.75 | 82.47 | 39.6 | 75.76 | 44.81 | 73.53 | 84.29 | 63.14 | 65.95 | 70.78 | 72.04 | 59.73 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
75.94 | 86.72 | 44.78 | 80.66 | 48.74 | 77.98 | 92.13 | 64.68 | 70.15 | 75.33 | 72.29 | 61.81 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
76.4 | 92.83 | 47.45 | 68.04 | 50.33 | 89.38 | 89.89 | 64.8 | 65.17 | 67.67 | 70 | 63.35 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
67.09 | 74.48 | 33.85 | 73.55 | 42.22 | 69.63 | 81.71 | 59.23 | 59.84 | 66.25 | 68.82 | 53.36 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
65.21 | 73.21 | 34.96 | 82.06 | 46.39 | 64.05 | 92.08 | 71.19 | 68.65 | 76.04 | 68.73 | 55.67 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
56.88 | 61.24 | 58.28 | 54.65 | 65.4 | 24.79 | 31.17 | 26.64 | 26.39 | 22.08 | 24.27 | 77.7 | 39.08 | 58.67 | 62.73 | 86.96 | 67.55 | 65.35 | 45.37 | 55.28 | 49.56 | 62.25 | 49.94 | 46.33 | 32.21 | 43.63 | 40.55 | 24.18 | 30.13 | 35.88 | 29.17 | 41.79 | 44.18 | 42.07 | 36.25 | 61.41 | 42.68 | 35.59 | 40.04 | 43.44 | 31.59 | 27.04 | 38.45 | 27.98 | 43.97 | 40.3 | 45.47 | 45.61 | 38.67 | 25.65 | 28.3 | 23.48 | 36.56 | 41.85 | 24.91 | 29.86 | 42.42 | 25.13 | 39.82 | 43.62 | 42.2 | 45.21 | 41.81 | 35.97 | 40.61 | 42.76 | 42.35 | 41.12 | 24.6 | 25.04 | 35.4 | 41.19 | 36.41 | 25.93 | 38.8 | 46.24 | 42.31 | 43.25 | 25.3 | 32.07 | 36.68 | 29.57 | 42.1 | 45.44 | 43.21 | 36.5 | 69.74 | 44.08 | 32.61 | 40.36 | 45.07 | 32.18 | 26.9 | 40.38 | 28.38 | 44.36 | 39.29 | 46.47 | 46.26 | 41.13 | 24.73 | 29.74 | 23.85 | 36.57 | 40.93 | 25.53 | 29.11 | 43.79 | 27.27 | 39.02 | 45.36 | 41.89 | 45.9 | 44.12 | 32.76 | 40.5 | 42.52 | 42.29 | 43 | 28.33 | 26.59 | 36.79 | 42.57 | 37.09 | 28.84 | 37.36 | 49.38 | 44.42 | 62.66 | 52.41 | |
59.08 | 65.88 | 64.92 | 56.42 | 74.94 | 24.52 | 35.1 | 29.1 | 27.4 | 21.72 | 23.98 | 74.68 | 42.23 | 62.9 | 60.37 | 81.52 | 67.37 | 63.13 | 47.05 | 52.28 | 45.07 | 58.24 | 48.81 | 44.34 | 34.2 | 43.11 | 37.79 | 23.72 | 29.64 | 39.48 | 26.55 | 38.78 | 43.56 | 40.39 | 37.29 | 58.08 | 41.18 | 36.42 | 38.76 | 43.67 | 31.98 | 28.04 | 38.14 | 26.05 | 41.16 | 38.63 | 44.04 | 46.21 | 37.61 | 24.47 | 26.24 | 17.83 | 37.27 | 40.93 | 17.89 | 32.98 | 40.91 | 17.83 | 39.48 | 41.76 | 42.62 | 44.54 | 39.97 | 37.46 | 38.29 | 40.95 | 41.85 | 38.33 | 19.03 | 19.38 | 34.09 | 40.29 | 38.86 | 27.83 | 38.71 | 45.78 | 42.32 | 40.25 | 25.69 | 32.4 | 40.53 | 27.23 | 38.7 | 44.75 | 41.36 | 38.44 | 66.34 | 44.18 | 34.83 | 40.56 | 45.92 | 32.08 | 28.37 | 39.49 | 25.9 | 40.96 | 38.56 | 46.59 | 46.25 | 39.66 | 25.28 | 28.97 | 19.27 | 35.73 | 39.57 | 19.9 | 32.43 | 42.32 | 20.86 | 40.47 | 43.59 | 41.88 | 46.31 | 42.53 | 35.95 | 38.69 | 40.47 | 41.52 | 39.55 | 22.88 | 20.51 | 34.93 | 40.75 | 39.07 | 29.75 | 38.02 | 48.55 | 45.18 | 62.79 | 54.82 | |
67.57 | 71.44 | 35.75 | 83.22 | 49.21 | 63.53 | 92.56 | 71.85 | 69.01 | 75.9 | 68.84 | 56.69 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
69.22 | 71.26 | 39.19 | 84.49 | 49.66 | 66.64 | 93.47 | 72.42 | 70.39 | 76.28 | 67.71 | 56.85 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
66.64 | 74.07 | 77.22 | 58.06 | 82.31 | 35.29 | 41.58 | 38.34 | 37.84 | 30.94 | 33.75 | 81.74 | 49.92 | 74.33 | 84.54 | 89.64 | 86.46 | 81.32 | 58.23 | 72.29 | 60.52 | 70.68 | 64.32 | 58.67 | 41.96 | 55.28 | 70 | 75.03 | 69.93 | 62.44 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
39.29 | 37.63 | 83.8 | 63.36 | 64.58 | 69.6 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
61.35 | 68.06 | 67.78 | 58.23 | 68.97 | 29.7 | 33.86 | 35.97 | 35.92 | 27.64 | 32.63 | 84.33 | 44.87 | 61.77 | 82.05 | 93.68 | 93.55 | 90.98 | 89.33 | 60.49 | 61.92 | 71.34 | 74.49 | 69.12 | 64.85 | 49.36 | 47.85 | 33.3 | 59.25 | 45.24 | 61.59 | 44.92 | 51.23 | 56.1 | 46.13 | 69.67 | 66.35 | 51.2 | 45.33 | 66.95 | 43.18 | 63.54 | 44.73 | 38.13 | 64.06 | 44.35 | 60.77 | 61.22 | 50.94 | 33.84 | 37.34 | 53.54 | 53.36 | 46.5 | 58.27 | 40.28 | 59.65 | 37.42 | 49.41 | 52.09 | 50.48 | 66.69 | 50.53 | 58.32 | 47.74 | 48.94 | 50.79 | 49.81 | 56.4 | 54.71 | 44.43 | 50.21 | 46.56 | 56.75 | 64.53 | 67.07 | 62.89 | 51.47 | 34.87 | 65.21 | 45.58 | 67.3 | 46.29 | 53.52 | 61.74 | 48.96 | 75.34 | 73.34 | 53.17 | 44.69 | 72.91 | 43.1 | 69.27 | 45.16 | 38.73 | 70.13 | 44.21 | 65.57 | 65.76 | 54.79 | 32.99 | 39.34 | 60.5 | 55.69 | 44.35 | 65.53 | 38.72 | 64.99 | 36.84 | 51.8 | 56.32 | 49.98 | 71.46 | 53.69 | 61.6 | 48.04 | 50.06 | 51.73 | 54.22 | 62.77 | 62.59 | 45.18 | 52.06 | 47.21 | 64.26 | 70.61 | 73.95 | 70.3 | 66.55 | 55.85 | |
76.22 | 87.53 | 42.61 | 81.87 | 46.86 | 75.55 | 92.05 | 73.24 | 72.22 | 75.78 | 72.76 | 63.31 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
88.13 | 91.53 | 47.86 | 78.51 | 52.73 | 88.32 | 93.89 | 67.98 | 68.9 | 73.35 | 71.05 | 64.13 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
86.21 | 88.36 | 44.64 | 77.04 | 51.76 | 81.17 | 93.72 | 70.26 | 67.48 | 72.59 | 71.82 | 63.31 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
85.09 | 86.54 | 42.96 | 82.66 | 53.24 | 79.79 | 95.07 | 72.26 | 71.48 | 76.47 | 70.33 | 61.58 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
79.72 | 87.96 | 42.65 | 83.33 | 49.44 | 75.96 | 93.21 | 74.77 | 72.25 | 76.76 | 74.12 | 61.38 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
77.69 | 90.05 | 43.02 | 84.14 | 48.05 | 82.11 | 93.86 | 76.4 | 73.22 | 77.39 | 70.56 | 61.21 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
70.35 | 72.76 | 73.61 | 65.55 | 55.74 | 60.23 | 20.12 | 53.83 | 70.47 | 70.81 | 73.55 | 66.56 | 40.99 | 15.73 | 59.24 | 58.95 | 57.41 | 50.54 | 28.97 | 4.78 | 47.38 | 2.61 | 26.24 | 46.69 | 28.74 | 45.28 | 47.85 | 46.33 | 30.1 | 48.85 | 47.64 | 35 | 48.93 | 44.56 | 25.77 | 23.21 | 45.8 | 16.85 | 48.28 | 45.6 | 49.62 | 37.51 | 44.92 | 17.7 | 4.4 | 3.95 | 28.49 | 49.23 | 2.81 | 31.64 | 48.66 | 3.8 | 46.17 | 47.35 | 46.46 | 48.66 | 46.83 | 30.74 | 47.53 | 47.7 | 47.97 | 48.14 | 17.38 | 2.83 | 16.15 | 46.44 | 46.5 | 28.24 | 46.77 | 25.11 | 24.23 | 49.09 | 7.19 | 27.68 | 45.12 | 29.82 | 47.32 | 46.12 | 47.04 | 29.35 | 48.12 | 47.71 | 36.23 | 47.91 | 44.44 | 26.28 | 25.24 | 46.54 | 20.01 | 48.21 | 46.39 | 48.47 | 39.92 | 47.35 | 22.32 | 8.4 | 7.6 | 31.63 | 48.27 | 7.85 | 32.12 | 50.02 | 9.85 | 45.68 | 46.79 | 44.33 | 45.17 | 45.79 | 29.66 | 48.74 | 45.94 | 48.28 | 50.56 | 22.2 | 6.61 | 26.25 | 44.27 | 45.14 | 30.3 | 45.6 | 32.37 | 30.09 | 55.47 | 41.45 | |||||||
72.63 | 85.12 | 37.79 | 84.7 | 45.63 | 74.73 | 93.06 | 78.19 | 73.87 | 77.54 | 67.67 | 58.44 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
65.03 | 67.13 | 31.44 | 81.68 | 42.21 | 71.17 | 91.88 | 68.25 | 69.79 | 75.68 | 66.09 | 55.03 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
70.81 | 67.05 | 35.85 | 74.67 | 42.31 | 63.69 | 92.48 | 70.27 | 69.05 | 75.8 | 68.22 | 59.19 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
69.84 | 65.24 | 33.95 | 72.79 | 35.6 | 66.32 | 90.4 | 62.28 | 66.12 | 73.74 | 67.56 | 57.24 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
70.67 | 67.73 | 32.62 | 74.12 | 38.64 | 68.43 | 90.12 | 65 | 67.23 | 72.79 | 68.99 | 57.01 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
76.19 | 69.63 | 35.53 | 78.13 | 45.48 | 64.06 | 92.94 | 74.43 | 71.69 | 77.2 | 70.17 | 59.31 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
79.06 | 70.19 | 34.29 | 75.89 | 40.26 | 61.14 | 87.22 | 69.45 | 65.6 | 70.37 | 70.26 | 54.49 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
77.6 | 91.27 | 45.88 | 81.64 | 47.06 | 86 | 92.7 | 72.56 | 71.62 | 76.36 | 71.1 | 61.46 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
77.78 | 92.81 | 46.71 | 83.53 | 46.95 | 86.15 | 93.69 | 75.31 | 73.04 | 77.65 | 72.11 | 60.39 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
79.22 | 93.75 | 48.61 | 84.55 | 49.45 | 91.69 | 94.62 | 77.14 | 73.84 | 78.11 | 70.9 | 60.94 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
71.72 | 78.97 | 79.66 | 73.33 | 90.64 | 41.83 | 44.55 | 40.53 | 39.68 | 37.44 | 37.23 | 82.74 | 45.18 | 85.46 | 89.63 | 93.13 | 90.59 | 86.21 | 87.32 | 86.24 | 71.23 | 75.27 | 71.27 | 67.68 | 69.24 | 71.71 | 59.98 | 53.66 | 57.46 | 62.59 | 61.13 | 50.06 | 66.64 | 66.09 | 64.68 | 72.11 | 68.4 | 67.25 | 65.78 | 67.95 | 62.05 | 64.95 | 64.97 | 60.08 | 66.64 | 56.39 | 68.93 | 68.94 | 54.26 | 48.99 | 44.69 | 59.19 | 66.34 | 60.34 | 63.09 | 58.76 | 62.48 | 58.56 | 66.18 | 67.3 | 68.37 | 68.98 | 65.54 | 69.02 | 62.35 | 61.23 | 68.54 | 56 | 58.71 | 59.72 | 65.6 | 60.86 | 67.41 | 61.52 | 66.17 | 69.16 | 64.65 | 65.09 | 58.52 | 62.24 | 63.75 | 65 | 52.84 | 72.42 | 71.95 | 70.18 | 77.08 | 71.5 | 70.25 | 69.13 | 71.89 | 67.44 | 69.16 | 70.75 | 63.14 | 70.7 | 60.94 | 72.32 | 74.65 | 59.69 | 54.37 | 48.31 | 62.15 | 72.45 | 62.81 | 68.04 | 61.44 | 66.9 | 61.64 | 71.63 | 72.11 | 70.6 | 70.83 | 69.19 | 72.99 | 65.26 | 66.49 | 73.14 | 59.89 | 62.38 | 62.59 | 71.61 | 62.74 | 71.67 | 64.64 | 70.01 | 75.42 | 70.69 | 69.78 | 61.28 | |
84.82 | 76.88 | 36.72 | 41.93 | 87.95 | 78.43 | 65.91 | 67.62 | 56.28 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
57.49 | 30.59 | 73.42 | 33.62 | 56.17 | 87.07 | 61.96 | 62.96 | 71.47 | 49.34 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
68.69 | 70.97 | 70.91 | 61.61 | 66.1 | 33.39 | 33.13 | 34.82 | 33.45 | 30.05 | 32.52 | 78.08 | 43.35 | 59.35 | 78.59 | 81.05 | 79.24 | 76.17 | 78.75 | 77.67 | 55.29 | 62.79 | 58.68 | 53.26 | 59.62 | 58.8 | 45.42 | 37.68 | 45.02 | 48.71 | 43.79 | 28.76 | 56.74 | 51.56 | 56.47 | 63.83 | 58.28 | 59.05 | 57.36 | 58.8 | 51.18 | 57.06 | 58.36 | 52.11 | 58.27 | 35.81 | 58.28 | 60.78 | 31.15 | 44.5 | 40.99 | 46.96 | 54.73 | 54.87 | 47.89 | 52.23 | 54.28 | 51.96 | 54.64 | 59.45 | 58.91 | 59.84 | 57.04 | 58.02 | 56.36 | 56.48 | 58.44 | 33.96 | 44.29 | 47.14 | 56.86 | 35.36 | 59.63 | 52.79 | 54.65 | 60.86 | 57.47 | 50.86 | 41.18 | 50.08 | 51.29 | 46.53 | 34.35 | 63.07 | 56.4 | 61.8 | 66.96 | 62.21 | 62.44 | 61.1 | 63.39 | 56.29 | 60.63 | 63.29 | 54.88 | 61.99 | 38.58 | 62.35 | 65.17 | 36.13 | 50.27 | 44.24 | 47.37 | 58.89 | 56.51 | 50.06 | 55.05 | 59.77 | 55.72 | 60.26 | 63.38 | 62.55 | 62.41 | 60.68 | 62.31 | 61.43 | 62.23 | 64.43 | 38.52 | 47 | 51.02 | 63.23 | 38.72 | 64.49 | 56.8 | 57.06 | 65.83 | 63.37 | 65.97 | 55.22 | |
64.87 | 65.17 | 31.02 | 74.12 | 36.71 | 66.9 | 89.13 | 62.62 | 61.95 | 70.2 | 63.57 | 51.04 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
71.65 | 73.79 | 75.81 | 64.19 | 88.7 | 40.25 | 44.7 | 40.39 | 38.86 | 37.68 | 37.5 | 79.42 | 42.45 | 80.82 | 87.47 | 91.07 | 89.27 | 84.23 | 86.02 | 85.35 | 65.86 | 71.08 | 67.97 | 61.32 | 66.3 | 67.52 | 57.07 | 51.96 | 54.43 | 59.8 | 59.38 | 46.56 | 62.97 | 62.73 | 61.6 | 70.3 | 66.31 | 65.54 | 61.46 | 65.47 | 58.05 | 64.07 | 60.95 | 57.4 | 64.17 | 52.26 | 65.54 | 68.23 | 50.85 | 48.45 | 42.83 | 57.51 | 63.79 | 54.99 | 61.9 | 57.1 | 58.99 | 55.9 | 61.96 | 65.64 | 64.53 | 66.85 | 60.81 | 65.76 | 56.52 | 57.99 | 65.03 | 53.57 | 57.26 | 57.83 | 64.07 | 58.91 | 63.54 | 59.28 | 64.07 | 68.24 | 62.54 | 63.04 | 56.84 | 59.62 | 60.85 | 62.77 | 50.18 | 68.93 | 69.19 | 67.07 | 74.48 | 69.83 | 68.71 | 65.95 | 68.76 | 63.81 | 67.69 | 66.47 | 59.5 | 67.92 | 56.49 | 69.04 | 73.89 | 56.63 | 52.24 | 46.62 | 59.16 | 69.85 | 56.66 | 66.54 | 59.31 | 64.88 | 58.86 | 67.37 | 70.87 | 68.22 | 68.18 | 64.65 | 69.48 | 60.18 | 62.86 | 70.89 | 58.15 | 59.44 | 60.85 | 70.66 | 60.88 | 68.05 | 62.11 | 67.44 | 74.47 | 68.32 | 69.39 | 62.62 | |
71.22 | 79.06 | 80.42 | 77.84 | 93.49 | 45.4 | 47.56 | 43.07 | 41.89 | 40.12 | 38.83 | 84.73 | 46.5 | 90.23 | 91.95 | 93.67 | 92.2 | 89 | 89.78 | 88.75 | 74.53 | 77.9 | 75.44 | 70.56 | 73.12 | 74.29 | 62.38 | 56.07 | 60.75 | 64.87 | 63.97 | 54.98 | 69.46 | 69.33 | 69.09 | 73.76 | 70.49 | 69.91 | 70.12 | 69.34 | 67.61 | 67.8 | 69.69 | 62.07 | 70.05 | 62.42 | 70.53 | 72.51 | 57.91 | 51.78 | 47.02 | 62.16 | 69.43 | 67.08 | 65.57 | 61.71 | 66.04 | 60.88 | 69.88 | 70.45 | 71.55 | 70.73 | 68.36 | 71.7 | 67.09 | 65.18 | 71.76 | 58.5 | 62.69 | 63.02 | 68.29 | 64.77 | 69.87 | 64.05 | 69.38 | 71.12 | 66.2 | 68.74 | 60.59 | 66.23 | 66.48 | 67.75 | 59.09 | 75.06 | 74.7 | 73.9 | 77.51 | 74.31 | 72.95 | 73.12 | 73.87 | 71.4 | 72.13 | 74.52 | 64.94 | 74.12 | 67.15 | 74.32 | 77.47 | 63.32 | 58.35 | 50.88 | 66.44 | 75.05 | 70.5 | 69.94 | 64.79 | 69.88 | 63.25 | 74.84 | 74.83 | 74.13 | 73.49 | 71.72 | 75.14 | 71.87 | 70.28 | 76.1 | 63.14 | 66.28 | 66.69 | 73.45 | 67.71 | 73.99 | 68.15 | 73.11 | 76.83 | 71.81 | 71.32 | 61.98 | |
64.58 | 61.93 | 28.5 | 74.49 | 34.39 | 58.27 | 89.86 | 59.04 | 65 | 72.15 | 59.69 | 53.54 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
66.58 | 65.1 | 30.63 | 84.11 | 41.33 | 65.75 | 91.72 | 74.95 | 71.43 | 77.05 | 65.53 | 56.47 |
Clustering Leaderboard ✨
Model | ArxivClusteringP2P | ArxivClusteringS2S | BiorxivClusteringP2P | BiorxivClusteringS2S | MedrxivClusteringP2P | MedrxivClusteringS2S | RedditClustering | RedditClusteringP2P | StackExchangeClustering | StackExchangeClusteringP2P | TwentyNewsgroupsClustering |
|---|---|---|---|---|---|---|---|---|---|---|---|
17.77 | 12.39 | 12.4 | 8.83 | 17.91 | 16.63 | 9.96 | 26.42 | 15.79 | 18.63 | 11.38 | |
32.13 | 22.05 | 29.84 | 20.57 | 30.13 | 24.82 | 28.79 | 49.14 | 35.43 | 28.83 | 23.28 | |
46.07 | 37.5 | 36.99 | 33.21 | 34.25 | 32.24 | 51.18 | 54.8 | 53.05 | 33.13 | 47.47 | |
46.55 | 37.86 | 38.48 | 33.17 | 34.41 | 32.29 | 50.67 | 54.15 | 53.36 | 38 | 46.86 | |
48.38 | 39.72 | 39.62 | 35.02 | 35.58 | 32.87 | 54.82 | 56.77 | 53.8 | 34.28 | 49.74 | |
44.75 | 35.27 | 39.52 | 34.53 | 35.04 | 31.66 | 24.13 | 35.06 | 39.01 | 31.46 | 24.22 | |
35.19 | 27.51 | 30.12 | 24.77 | 26.09 | 23.6 | 27.24 | 43.32 | 43.58 | 26.55 | 23.35 | |
42.61 | 32.32 | 34.97 | 29.08 | 31.19 | 27.27 | 54.89 | 57.58 | 63.15 | 32.25 | 46.82 | |
32.56 | 23.14 | 29.27 | 19.18 | 26.12 | 20.38 | 28.46 | 35.82 | 35.8 | 28.51 | 25.83 | |
35.49 | 27.18 | 27.66 | 23.25 | 27.57 | 25.13 | 56.13 | 58.53 | 64.21 | 33.01 | 46.72 | |
37.5 | 30.55 | 29.59 | 25.72 | 28.72 | 27.39 | 61.69 | 61.67 | 69.93 | 33.21 | 51.64 | |
37.9 | 30.45 | 30.52 | 26.06 | 28.69 | 26.69 | 61.34 | 61.11 | 69.95 | 32.73 | 51.15 | |
37.9 | 32.39 | 30.48 | 27.5 | 29.12 | 27.56 | 64.13 | 62.84 | 71.43 | 32.85 | 50.44 | |
34.73 | 26.01 | 29.76 | 20.71 | 26.65 | 21.5 | 28.84 | 7.37 | 39.04 | 30.23 | 27.42 | |
36.94 | 29.03 | 32.35 | 28.16 | 30.23 | 27.01 | 48.04 | 53.53 | 59.54 | 30.48 | 38.68 | |
38.33 | 31.55 | 33.49 | 29.44 | 31.52 | 30.87 | 42.02 | 50.73 | 49.6 | 31.69 | 39.28 | |
37.78 | 31.68 | 33.09 | 29.6 | 31.96 | 31.7 | 45.24 | 51.31 | 52.98 | 32.94 | 44.1 | |
39.28 | 27.26 | 33.99 | 22.92 | 33.2 | 26.13 | 52.93 | 59.67 | 63.13 | 35.68 | 48.1 | |
41.62 | 29.44 | 35.99 | 24.02 | 32.4 | 26.33 | 54.53 | 62.5 | 65.11 | 36.86 | 49.33 | |
41.62 | 31.17 | 36.43 | 26.47 | 32.3 | 26.93 | 57.03 | 62.34 | 67.13 | 34.79 | 49.53 | |
42.89 | 33.47 | 36.53 | 28.66 | 32.09 | 26.82 | 58.99 | 64.46 | 70.78 | 35.25 | 50.93 | |
35.18 | 27.54 | 30.15 | 24.67 | 26.25 | 24.12 | 40.23 | 47.74 | 47.55 | 29.45 | 34.86 | |
45.01 | 36.85 | 36.66 | 34.21 | 32.6 | 30.8 | 61.42 | 64.13 | 72.22 | 38.49 | 52.56 | |
41.49 | 28.47 | 36.86 | 27.55 | 31.09 | 26.5 | 42.47 | 58.1 | 53.52 | 30.43 | 36.26 | |
45.64 | 53.01 | 42.01 | |||||||||
40.79 | 55.14 | 37.64 | |||||||||
31.78 | 36.86 | 29.33 | |||||||||
32.92 | |||||||||||
26.05 | 25.67 | 44.92 | |||||||||
32.61 | 24.68 | 24.9 | 19.55 | 23.6 | 21.97 | 32.18 | 45.14 | 43.07 | 28.5 | 23.21 | |
43.38 | 33.71 | 35.06 | 30.71 | 32.08 | 29.45 | 48.23 | 53.18 | 60.86 | 32.36 | 40.06 | |
39.71 | 28.24 | 33.63 | 27.04 | 31.37 | 26.87 | 40.23 | 49.09 | 52.74 | 32.66 | 32.13 | |
34.74 | 24.68 | 28.93 | 23.08 | 28.3 | 24.93 | 33.76 | 41.01 | 44.59 | 28.23 | 28.24 | |
44.72 | 35.08 | 34.41 | 30.53 | 31.35 | 28.77 | 46.47 | 54.17 | 59.19 | 32.57 | 40.89 | |
45.59 | 38.86 | 36.55 | 33.7 | 31.51 | 28.76 | 40.45 | 55.75 | 59.21 | 33.95 | 39.46 | |
40.55 | 32.49 | 33.59 | 29.13 | 30.33 | 28.02 | 42.17 | 48.02 | 54.13 | 31.12 | 37.2 | |
44.59 | 38.03 | 36.03 | 32.48 | 31.05 | 29.26 | 35.53 | 54.52 | 55.13 | 34.31 | 37.28 | |
44.14 | 37.14 | 35.81 | 31.86 | 31.34 | 28.2 | 42.87 | 56.39 | 59.08 | 30.3 | 37.51 | |
43.16 | 32.56 | 37.62 | 31.33 | 34.22 | 32 | 63.65 | 64.63 | 68.78 | 36.15 | 54.13 | |
39.68 | 29.19 | 32.98 | 25.72 | 30.89 | 28.38 | 59.26 | 63.22 | 65.04 | 35.28 | 51.31 | |
42.45 | 32.21 | 37.37 | 30.55 | 33.19 | 30.79 | 63.49 | 65.13 | 68.44 | 35.17 | 53.38 | |
44.57 | 40.48 | 36.19 | 32.72 | 31.53 | 28.29 | 48.18 | 62.19 | 63.91 | 32.56 | 42.58 | |
46.19 | 41.38 | 37.6 | 35.09 | 32.26 | 29.66 | 50.69 | 61.37 | 64.96 | 33.6 | 43.81 | |
45.73 | 39.14 | 37.61 | 34.5 | 33.67 | 31.95 | 47.14 | 51.6 | 49.34 | 31.52 | 44.23 | |
48.32 | 39.45 | 39.35 | 35.3 | 35.68 | 33.3 | 55.1 | 56.77 | 53.75 | 34.26 | 50.5 | |
34.75 | 22.62 | 28.75 | 20.14 | 31.2 | 25.8 | 46.17 | 56.53 | 49.34 | 33.4 | 36.93 | |
33.72 | 23.99 | 30.88 | 21.05 | 28.68 | 24.25 | 43.82 | 58.37 | 47.83 | 33.01 | 37.47 | |
35.13 | 23.46 | 31.17 | 18.81 | 28.88 | 23.31 | 49.72 | 57.92 | 54.64 | 31.58 | 38.23 | |
34.72 | 25.27 | 28.39 | 20.52 | 30.27 | 24.58 | 56.93 | 58.95 | 60.85 | 33.14 | 42.43 | |
42.12 | 34.8 | 35.89 | 30.05 | 31.34 | 27.88 | 45.72 | 59.66 | 58.51 | 31.98 | 41.13 | |
46.1 | 39.67 | 37.5 | 32.72 | 31.46 | 28.99 | 56.16 | 63.43 | 65.15 | 32.5 | 48.16 | |
45.55 | 41.02 | 37.36 | 34.85 | 31.82 | 30.38 | 55.83 | 63.38 | 65.92 | 33.67 | 49.6 | |
40.28 | 35.42 | 35.04 | 29.46 | 28.92 | 28.43 | 42.41 | 55.17 | 55.27 | 30.46 | 35.97 | |
30.15 | 24.29 | 23.01 | 21.29 | 35.55 | 18.35 | ||||||
29.33 | 27.81 | ||||||||||
32.32 | 25.5 | 28.99 | 23.2 | 29.44 | 26.16 | 31.25 | 43.3 | 34.36 | 30.64 | 31.58 | |
42.01 | 31.41 | 34.73 | 29.28 | 31.77 | 30.94 | 43.09 | 56.54 | 48.23 | 34.76 | 34.36 | |
39.22 | 30.8 | 35.75 | 27.05 | 30.9 | 27.26 | 39.13 | 58.98 | 53.52 | 32.07 | 33.22 | |
44.31 | 38.43 | 35.34 | 33.5 | 31.48 | 29.71 | 46.54 | 63.22 | 57.53 | 32.69 | 38.91 | |
34.98 | 24.37 | 29.66 | 22.32 | 28.26 | 23.87 | 35.85 | 47.27 | 47.81 | 29.83 | 32.41 | |
39.22 | 29.88 | 32.99 | 26.49 | 30.01 | 25.57 | 43.1 | 51.71 | 52.08 | 31.61 | 39.27 |
Clustering Leaderboard ✨🇩🇪
Model | BlurbsClusteringP2P | BlurbsClusteringS2S | TenKGnadClusteringP2P | TenKGnadClusteringS2S |
|---|---|---|---|---|
30.82 | 12.69 | 23.5 | 10.94 | |
35.36 | 11.27 | 37.16 | 24.23 | |
39.3 | 13.38 | 41.69 | 34.97 | |
10.06 | 7.74 | 9.02 | 4.11 | |
13.96 | 7.57 | 11.49 | 3.91 | |
34.49 | 8.37 | 33.66 | 9.34 | |
11.37 | 8.01 | 15.89 | 4.84 | |
32.46 | 14.33 | 36.13 | 22.26 | |
34.38 | 15.81 | 35.96 | 22 | |
30.59 | 11.57 | 44.88 | 18.11 | |
35.33 | 13.27 | 44.11 | 17.26 | |
39.91 | 15.94 | 43.43 | 19.69 | |
29.63 | 15.24 | 37.1 | 25.64 | |
29.84 | 7.29 | 32.46 | 6.16 | |
8 |
Pair Classification Leaderboard 🎭
Model | SprintDuplicateQuestions | TwitterSemEval2015 | TwitterURLCorpus |
|---|---|---|---|
65.54 | 59.57 | 81.47 | |
89.26 | 62.78 | 84.58 | |
92.45 | 70.02 | 84.77 | |
94.55 | 67.86 | 84.7 | |
90.15 | 73.85 | 85.11 | |
71.63 | 43.25 | 69.22 | |
36.81 | 55.9 | 76.29 | |
95.55 | 66.85 | 85.21 | |
86.96 | 48.45 | 77.35 | |
94.55 | 72.23 | 84.77 | |
95.05 | 76.03 | 84.89 | |
95.45 | 77.81 | 85.14 | |
95.68 | 77.54 | 85.13 | |
85.55 | 53.85 | 79.41 | |
96.09 | 65.95 | 83.17 | |
89.46 | 62.06 | 83.83 | |
90.55 | 66.75 | 85.14 | |
91.23 | 78.25 | 86.05 | |
89.01 | 79.75 | 86.14 | |
91.44 | 80.89 | 85.86 | |
88.89 | 80.28 | 86.01 | |
69.39 | 67.75 | 83.89 | |
92.17 | 75.28 | 87.22 | |
77.85 | 69.04 | 83.69 | |
76.46 | 70.85 | 85.08 | |
79.85 | 69.45 | 84.06 | |
69.52 | 74.42 | 83.75 | |
69.41 | 60.21 | 81.37 | |
92.58 | 62.37 | 83.79 | |
89.89 | 54.75 | 81.06 | |
77.73 | 57.09 | 80.51 | |
93.47 | 63.68 | 84.8 | |
93.84 | 66.87 | 85.29 | |
80.54 | 66 | 84.54 | |
94.93 | 65.31 | 85.46 | |
95.29 | 74.16 | 85.79 | |
93.07 | 77.42 | 87.18 | |
90.35 | 73.99 | 86.2 | |
94.94 | 77.99 | 86.93 | |
94.88 | 74.4 | 85.98 | |
95.42 | 76.1 | 86.31 | |
84.82 | 76.85 | 84.77 | |
90.15 | 73.85 | 85.11 | |
90.89 | 63.76 | 84.2 | |
87.05 | 57.03 | 82.21 | |
86.37 | 60.64 | 81.68 | |
84.37 | 70.13 | 84.09 | |
77.36 | 63.58 | 82.64 | |
94.88 | 73.34 | 85.79 | |
94.58 | 75.97 | 86.63 | |
94.92 | 76.92 | 86.25 | |
93.01 | 72.21 | 85.48 | |
57.56 | |||
83.53 | 62.49 | 83.46 | |
93.23 | 69.6 | 83.49 | |
92.18 | 70.75 | 84.83 | |
93.13 | 75.28 | 85.83 | |
90.94 | 61.49 | 82.85 | |
91.08 | 68.63 | 84.82 |
Retrieval Leaderboard 🔎
Model | ArguAna | CQADupstackAndroidRetrieval | CQADupstackEnglishRetrieval | CQADupstackGamingRetrieval | CQADupstackGisRetrieval | CQADupstackMathematicaRetrieval | CQADupstackPhysicsRetrieval | CQADupstackProgrammersRetrieval | CQADupstackRetrieval | CQADupstackStatsRetrieval | CQADupstackTexRetrieval | CQADupstackUnixRetrieval | CQADupstackWebmastersRetrieval | CQADupstackWordpressRetrieval | ClimateFEVER | DBPedia | FEVER | FiQA2018 | HotpotQA | MSMARCO | NFCorpus | NQ | QuoraRetrieval | SCIDOCS | SciFact | TRECCOVID | Touche2020 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
12.86 | 0 | 7.52 | 10.13 | 3.4 | 2.33 | 6.84 | 5.05 | 4.12 | 5.18 | 3.57 | 5.33 | 0.07 | 0 | 0.36 | 1.53 | 0.77 | 1.73 | 5.5 | 1.09 | 2.44 | 0.64 | 71.14 | 0.78 | 4.04 | 10.97 | 1.06 | |
34.18 | 29.83 | 14.35 | 29.62 | 17.15 | 12.05 | 19.76 | 19.15 | 18.75 | 14.61 | 12.65 | 21.34 | 21.02 | 13.48 | 3.83 | 15.57 | 12.18 | 7 | 18.75 | 7.6 | 16.54 | 8.42 | 77.03 | 5.63 | 38.2 | 16.34 | 4.88 | |
47.13 | 54.12 | 49.85 | 56.86 | 41.41 | 31.86 | 46.81 | 41.33 | 42.53 | 37.82 | 31.66 | 43.86 | 41.38 | 33.46 | 21.57 | 33.35 | 55.9 | 37.27 | 44.59 | 39.03 | 32.25 | 46.47 | 87.75 | 21.82 | 62.64 | 50.82 | 17.22 | |
50.17 | 53.83 | 47.78 | 56.92 | 41.31 | 29.29 | 46.98 | 38.97 | 41.32 | 35.38 | 30.52 | 41.31 | 40.47 | 33.15 | 20.27 | 32.33 | 51.93 | 36.87 | 46.51 | 36.54 | 31.59 | 43.87 | 87.56 | 21.64 | 64.51 | 47.25 | 16.9 | |
46.52 | 56.49 | 52.29 | 60.03 | 44.27 | 34.21 | 50.97 | 44.17 | 44.96 | 38.15 | 33.35 | 45.41 | 44.24 | 35.94 | 21.97 | 32.09 | 50.86 | 49.96 | 39.29 | 39.75 | 33.29 | 50.45 | 87.46 | 23.76 | 65.57 | 51.33 | 19.93 | |
32.67 | 18.91 | 14.31 | 18.14 | 13.61 | 11.09 | 21.98 | 15.69 | 14.6 | 14.4 | 8.04 | 12.33 | 17.51 | 9.18 | 6.86 | 4.14 | 5.45 | 5.64 | 5.46 | 5.59 | 0.85 | 5.99 | 64.65 | 0 | 47.88 | 29.91 | 8.46 | |
28.29 | 10.06 | 8.38 | 9.08 | 4.49 | 2.12 | 8.4 | 4.61 | 5.51 | 2.84 | 2.67 | 4.66 | 5.89 | 2.89 | 5.41 | 4.13 | 3.3 | 2.19 | 8.26 | 1.91 | 4.3 | 2.62 | 61.03 | 2.82 | 13.34 | 14.74 | 0.97 | |
48.32 | 44.49 | 40.65 | 51.05 | 28.84 | 22.38 | 39.65 | 34.94 | 33.67 | 29.21 | 21.15 | 31.7 | 34.93 | 25.04 | 24.79 | 38.1 | 59.29 | 27.42 | 56.81 | 36.77 | 31.32 | 41.83 | 86.72 | 17.12 | 65.51 | 44.77 | 15.79 | |
36.3 | 23.39 | 15.7 | 27.84 | 11.19 | 8.67 | 21.24 | 13.49 | 15.47 | 12.3 | 9.08 | 14.44 | 17.22 | 11.13 | 14.44 | 18.28 | 14.99 | 10.09 | 19.18 | 9.6 | 13.87 | 12.87 | 71.32 | 8.04 | 29.58 | 36.22 | 13.99 | |
50.83 | 43.3 | 43.93 | 52.47 | 30.68 | 23.68 | 36.78 | 37.58 | 34.55 | 28.5 | 23.35 | 32.97 | 34.21 | 27.15 | 24.88 | 35.24 | 68.93 | 35.15 | 54.93 | 41.16 | 30.22 | 50.47 | 87.98 | 14 | 59.74 | 56.05 | 25.89 | |
52.09 | 46.05 | 46.83 | 56.34 | 33.72 | 24.85 | 38.47 | 38.49 | 36.62 | 30.44 | 25.07 | 35.3 | 35.66 | 28.21 | 26.9 | 39.55 | 72.66 | 42.79 | 57.85 | 42.73 | 32.63 | 55.09 | 88.47 | 15.51 | 63.42 | 56.68 | 28.29 | |
52.81 | 44.93 | 46.48 | 55.81 | 34.64 | 27.42 | 39.65 | 39.61 | 37.35 | 30.09 | 26.05 | 36.63 | 36.47 | 30.42 | 27.01 | 39.74 | 72.18 | 44.19 | 58.91 | 43.52 | 33.34 | 56.16 | 88.91 | 15.71 | 64.2 | 60.09 | 25.26 | |
53.77 | 47.65 | 47.9 | 57.47 | 35.21 | 27.25 | 41.33 | 40.16 | 38.56 | 32.02 | 26.98 | 38.35 | 37.41 | 30.99 | 27.21 | 41.28 | 74.08 | 46.78 | 59.67 | 44.05 | 34.18 | 57.24 | 89.09 | 15.88 | 66.77 | 51.9 | 26.76 | |
30.96 | 24.56 | 17.58 | 29.44 | 12.32 | 9.54 | 22.67 | 15.29 | 16.79 | 14.28 | 9.93 | 15.15 | 18.24 | 12.46 | 14.87 | 15.88 | 15.56 | 10.49 | 20.77 | 9.75 | 11.79 | 12.75 | 71.57 | 8.47 | 29.53 | 35.92 | 13.17 | |
45.15 | 41.04 | 32.16 | 45.07 | 25.75 | 16.54 | 31.07 | 25.2 | 27.72 | 24.23 | 16.03 | 27.31 | 28 | 20.2 | 16.96 | 27.86 | 45.68 | 15.62 | 35.61 | 29.57 | 22.29 | 29.85 | 86.51 | 10.13 | 52.31 | 40.54 | 8.57 | |
44.88 | 40.65 | 35.66 | 44.33 | 28.04 | 21.44 | 34.74 | 32.58 | 30.7 | 24.64 | 20.5 | 32.17 | 30.7 | 23.02 | 18.49 | 22.63 | 52.66 | 20.33 | 30.01 | 23.72 | 23.45 | 29.8 | 86.55 | 0.03 | 48.37 | 39.12 | 16.06 | |
48.91 | 42.78 | 35.83 | 44.84 | 27.33 | 22.91 | 34.89 | 34.46 | 31.32 | 24.95 | 20.61 | 31.5 | 30.66 | 25.01 | 15.27 | 26.22 | 56.76 | 22.96 | 37.03 | 26.6 | 25.49 | 33.6 | 86.4 | 13.97 | 50.3 | 37.87 | 17.4 | |
44.85 | 46.18 | 37.03 | 53.95 | 32.34 | 24.7 | 38.8 | 40.16 | 35.23 | 29.37 | 23.04 | 34.96 | 35.64 | 26.61 | 10.37 | 27.77 | 26.17 | 34.83 | 33.2 | 20.7 | 28.65 | 36.32 | 85.49 | 14.15 | 45.76 | 40.7 | 20.3 | |
39.27 | 50.35 | 42.09 | 58.4 | 35.38 | 27.69 | 41.91 | 44.15 | 38.96 | 32.4 | 26.19 | 39.83 | 40.97 | 28.17 | 11.36 | 31.55 | 36.21 | 43.55 | 33.95 | 23.96 | 31.1 | 42.02 | 85.73 | 15.38 | 49.91 | 46.11 | 21.63 | |
39.4 | 51.12 | 44.77 | 59.93 | 37.32 | 30.63 | 43.57 | 45.58 | 40.78 | 32.66 | 27.69 | 41.81 | 42.31 | 31.93 | 10.61 | 33.65 | 36.12 | 44.71 | 37.17 | 25.17 | 33.18 | 46.29 | 85.85 | 15.97 | 50.91 | 54.77 | 22.51 | |
39.85 | 55.07 | 49.42 | 63.46 | 41.55 | 33.79 | 47.72 | 47.93 | 44.65 | 36.23 | 32.1 | 46.61 | 45.67 | 36.31 | 14.63 | 39.19 | 51.2 | 46.68 | 42.14 | 27.67 | 35.08 | 52.87 | 85.96 | 17.17 | 55.38 | 59.48 | 21.65 | |
38.33 | 21.38 | 17.63 | 28 | 10.33 | 8.16 | 19.71 | 14.68 | 14.5 | 11.49 | 7.73 | 12.52 | 13.92 | 8.41 | 11.98 | 19.73 | 20.41 | 10.41 | 22.9 | 11 | 12.42 | 16.08 | 79.62 | 7.53 | 29.59 | 22.93 | 9.9 | |
57.44 | 51.26 | 49.26 | 59.25 | 39.84 | 30.92 | 45.18 | 43.44 | 41.69 | 33.91 | 29.97 | 43.99 | 39.71 | 33.57 | 21.64 | 39.39 | 74.99 | 44.41 | 60.9 | 40.91 | 36.97 | 51.58 | 87.6 | 18.36 | 72.75 | 68.47 | 21.61 | |
39.65 | 17.62 | 12.07 | 19.59 | 8.01 | 4.7 | 10.95 | 9.41 | 10.17 | 7.15 | 4.21 | 9.79 | 12.02 | 6.52 | 2.83 | 3.48 | 4.45 | 7.54 | 12.6 | 10.53 | 20.59 | 2.02 | 82.18 | 6.28 | 45.46 | 24.56 | 3.1 | |
13.05 | 9.9 | 15.74 | 8.23 | 8.76 | 5.14 | 19.96 | 83.11 | 46.68 | 7.61 | ||||||||||||||||||
46.91 | 18.5 | 36.2 | 72.1 | 38.41 | 59.39 | 37.94 | 33.17 | 42.81 | 70.57 | 14.83 | 67.25 | 72.43 | 28.68 | ||||||||||||||
49.2 | 19.9 | 77 | 42.2 | 63.1 | 36.7 | 69.7 | 70.4 | 58.5 | 29.7 | ||||||||||||||||||
46.98 | 44.51 | 47.14 | 19.4 | 75.6 | 45.21 | 64.8 | 38.01 | 67.7 | 17.74 | 74.35 | 56.14 | 30.9 | |||||||||||||||
43.5 | 22.3 | 77.5 | 51.2 | 68.8 | 40.7 | 63.8 | 75.4 | 64.9 | 29.1 | ||||||||||||||||||
38.34 | 21.33 | 17.23 | 25.7 | 9.91 | 5.94 | 18.12 | 13.8 | 13.22 | 9.75 | 5.42 | 10.98 | 13.89 | 6.61 | 11.8 | 15.04 | 21.06 | 9.84 | 19.75 | 9.35 | 9.88 | 11.69 | 78.03 | 5.5 | 25.72 | 26.2 | 8.9 | |
49.68 | 41.47 | 39.77 | 49.66 | 30.35 | 23.38 | 39.04 | 35.73 | 33.33 | 27.8 | 21.24 | 32.46 | 33.38 | 25.64 | 26.6 | 31.51 | 68.12 | 29.99 | 49.93 | 36.05 | 32.08 | 42.94 | 85.28 | 16.18 | 68.29 | 72.98 | 24.45 | |
45.42 | 33.37 | 31.69 | 39.8 | 25.11 | 19.43 | 32.32 | 28.83 | 27.25 | 24.52 | 16.82 | 25.37 | 27.25 | 22.47 | 21.86 | 22.72 | 60.45 | 21.12 | 40.88 | 27.98 | 22.79 | 29.73 | 72.98 | 12.21 | 56.9 | 70.3 | 22.97 | |
31.04 | 28.72 | 18.8 | 33.34 | 17.32 | 14.48 | 23.11 | 20.62 | 20.29 | 17.69 | 11.24 | 20.3 | 22.77 | 15.09 | 11.01 | 10.87 | 18.4 | 8.94 | 17.73 | 6.27 | 11.8 | 7.63 | 78.96 | 7.13 | 31.79 | 39.31 | 12.27 | |
50.49 | 46.69 | 42.41 | 53.68 | 33.97 | 24.04 | 43.01 | 37.94 | 36.53 | 31.01 | 24.4 | 35.32 | 37.2 | 28.75 | 27.11 | 34.7 | 72.73 | 33.29 | 52.84 | 38.83 | 33.89 | 46.7 | 85.6 | 16.57 | 70.17 | 75.17 | 23.44 | |
51.38 | 47.67 | 46.38 | 55.83 | 36.95 | 28.63 | 45.57 | 41.48 | 39.4 | 33.4 | 26.81 | 38.74 | 39.57 | 31.82 | 30.46 | 39.87 | 78.24 | 37.2 | 59.26 | 39.91 | 36.21 | 52.41 | 84.58 | 19.87 | 74.7 | 84.88 | 25.43 | |
35.07 | 40.35 | 31.61 | 45.07 | 24.89 | 20.98 | 35.22 | 30.91 | 29.98 | 25.14 | 18.77 | 30.64 | 32.42 | 23.75 | 17.57 | 26.1 | 38.64 | 18.59 | 33.99 | 15.83 | 28.26 | 24.63 | 84.68 | 13.55 | 46.66 | 55.35 | 16.18 | |
47.28 | 47.68 | 46.29 | 56.68 | 37.04 | 26.48 | 45.61 | 40.53 | 39.62 | 35.44 | 28.23 | 38.41 | 40.85 | 32.22 | 29.39 | 39.03 | 73.97 | 35.84 | 57.26 | 41.12 | 35.78 | 53.15 | 74.71 | 18.62 | 72.11 | 81.37 | 23.98 | |
46.69 | 45.78 | 42.99 | 53.31 | 33.7 | 24.39 | 40.54 | 36.79 | 36.08 | 30.9 | 26.46 | 34.27 | 34.98 | 28.86 | 15.81 | 38.64 | 53.52 | 34.8 | 56.34 | 42.33 | 33.93 | 58.73 | 87.71 | 16.42 | 65.6 | 76.78 | 26.81 | |
57.05 | 55.9 | 50.77 | 63.07 | 39.51 | 30.66 | 47.82 | 47.45 | 43.82 | 34.62 | 30.03 | 44.68 | 46.39 | 34.91 | 27.74 | 36.68 | 72.69 | 45.45 | 55.18 | 39.65 | 34.09 | 50.1 | 88.44 | 18.55 | 64.43 | 58.06 | 21.56 | |
52.03 | 52.61 | 47.18 | 58.84 | 38.47 | 28.28 | 44.22 | 45.3 | 40.95 | 33.1 | 28.2 | 40.36 | 42.82 | 32.02 | 27.95 | 33.34 | 71.85 | 39.18 | 54.19 | 37.76 | 31.59 | 45.88 | 88.19 | 17.09 | 57.83 | 58.55 | 20.37 | |
55.65 | 54.99 | 49.32 | 63.36 | 40.58 | 30.84 | 45.28 | 44.9 | 43.09 | 35.65 | 29.09 | 42.52 | 45.14 | 35.47 | 26.54 | 40.24 | 70.03 | 46.96 | 55.88 | 41.61 | 36 | 57.24 | 88.85 | 17.36 | 64.56 | 71.4 | 23.44 | |
51.41 | 45.61 | 45.72 | 55.03 | 37.28 | 28.26 | 42.91 | 40.82 | 38.92 | 33.73 | 29.68 | 38.31 | 36.52 | 33.18 | 15.38 | 41.02 | 58.24 | 36.37 | 62.21 | 43.14 | 36.59 | 59.97 | 87.92 | 18.99 | 73.08 | 79.64 | 28.31 | |
49.35 | 46.85 | 47.18 | 57.41 | 36.97 | 28.95 | 43.5 | 39.97 | 39.44 | 33.36 | 30.15 | 38.57 | 37.96 | 32.45 | 22.4 | 42.39 | 65.03 | 38.56 | 63.33 | 44.05 | 36.07 | 62.86 | 88.18 | 20.12 | 72.58 | 78.32 | 27.21 | |
41.67 | 45.09 | 42.04 | 55.69 | 34.64 | 25.15 | 40.42 | 39.47 | 37.07 | 32.53 | 25.97 | 35.97 | 36.61 | 31.24 | 22.87 | 41.32 | 81.64 | 37.43 | 66.61 | 41.46 | 32.45 | 59.11 | 85.71 | 17.77 | 68.85 | 74.53 | 27.12 | |
44.49 | 50.38 | 42.9 | 57.59 | 35.62 | 26.27 | 41.78 | 41.17 | 38.54 | 32.82 | 25.89 | 37.71 | 40.59 | 29.81 | 26.56 | 42.23 | 84.99 | 39.88 | 69.15 | 41.77 | 35.39 | 58.22 | 86.56 | 18.69 | 71.94 | 69.6 | 26.4 | |
46.42 | 50.27 | 42.69 | 57.28 | 35.2 | 25.83 | 41.34 | 39.97 | 37.89 | 31.06 | 25.15 | 38.35 | 39.36 | 28.19 | 22.21 | 44.02 | 82.83 | 41.14 | 73.13 | 43.46 | 37.13 | 63.44 | 86.84 | 20.51 | 72.24 | 66.54 | 20.67 | |
44.23 | 47.83 | 44.06 | 59.2 | 34.93 | 27.03 | 41.58 | 40.7 | 38.52 | 32.59 | 27.31 | 36.73 | 39.21 | 31.11 | 23.86 | 40.36 | 79.44 | 38.17 | 68.56 | 42.27 | 32.46 | 60.02 | 87.65 | 17.16 | 69.35 | 69.76 | 21.35 | |
83.07 | |||||||||||||||||||||||||||
37.27 | 23.63 | 26.09 | 33.34 | 13.88 | 9.67 | 23.39 | 19.67 | 18.81 | 16.03 | 10.2 | 17.25 | 21.07 | 11.56 | 8.69 | 14.77 | ||||||||||||
47.29 | 36.16 | 40.7 | 44.83 | 27.45 | 22.98 | 35.55 | 30.3 | 31.03 | 25.27 | 22.2 | 30.15 | 31.39 | 25.37 | 13.48 | 22.45 | ||||||||||||
39.06 | 36.07 | 22.55 | 37.76 | 75.27 | 33.31 | 65.09 | 40.99 | 31.01 | 56.29 | 86.93 | 13.89 | 67.7 | 72.57 | 21.16 | |||||||||||||
54.38 | 39.68 | 25.73 | 41.29 | 82.81 | 43.8 | 71.23 | 43.7 | 33.99 | 64.06 | 88.18 | 17.47 | 70.41 | 71.33 | 23.39 | |||||||||||||
45.18 | 16.62 | 26.72 | 61.24 | 26.65 | 43.1 | 29.7 | 25.13 | 37.97 | 85.62 | 15.15 | 53.59 | 50.63 | 20.08 | ||||||||||||||
49.35 | 20.78 | 31.35 | 67.59 | 35.48 | 49.64 | 33.02 | 29.3 | 43.61 | 87.07 | 17.71 | 58.6 | 54.63 | 18.06 |
Reranking Leaderboard 🥈
Model | AskUbuntuDupQuestions | MindSmallReranking | SciDocsRR | StackOverflowDupQuestions |
|---|---|---|---|---|
48.99 | 24.79 | 54.99 | 36.98 | |
52.75 | 29.81 | 68.72 | 42.42 | |
64.06 | 31.02 | 87.2 | 51.47 | |
63.48 | 30.8 | 87.12 | 50.76 | |
65.85 | 30.97 | 88.65 | 51.98 | |
50.07 | 24.8 | 81.31 | 36.22 | |
45.84 | 28.37 | 64.94 | 34.62 | |
56.69 | 31.58 | 76.51 | 47.78 | |
49.57 | 27.01 | 62.56 | 34.03 | |
60.86 | 31.33 | 73.71 | 51.01 | |
61.64 | 31.84 | 76.39 | 51.58 | |
63.08 | 31.5 | 76.49 | 52.79 | |
63.23 | 31.93 | 77.96 | 53.5 | |
50.88 | 28.92 | 63.55 | 35.65 | |
58.99 | 27.13 | 72.78 | 48.48 | |
60.49 | 30.37 | 77.78 | 45.85 | |
60.16 | 30.15 | 78.09 | 46.79 | |
59.73 | 30.2 | 73.96 | 48.46 | |
61.51 | 30.27 | 74.88 | 49.34 | |
62.86 | 29.77 | 75.16 | 51.05 | |
66.16 | 30.6 | 76.09 | 52.85 | |
51.8 | 29.3 | 70.14 | 38.9 | |
62.05 | 31.45 | 81.22 | 50.54 | |
53.49 | 30.71 | 71.04 | 40.85 | |
54.68 | 72.78 | 40.65 | ||
55.09 | 70.93 | 42.42 | ||
53.56 | 68.7 | 39.41 | ||
51.57 | 28.62 | 66.33 | 39.35 | |
58.13 | 31.34 | 77.21 | 49.32 | |
55.84 | 30.4 | 71.34 | 44.74 | |
52.63 | 29.27 | 68.36 | 39.97 | |
59.63 | 31.72 | 77.72 | 49.61 | |
61.63 | 32.29 | 80.79 | 51.53 | |
55.9 | 31.11 | 77.54 | 44.77 | |
59.97 | 31.79 | 79.77 | 51.07 | |
59.36 | 29.56 | 79.76 | 49.13 | |
64.3 | 31.68 | 82 | 52.17 | |
63.17 | 31.82 | 78.83 | 50.99 | |
65.35 | 31.81 | 79.49 | 52.52 | |
59.66 | 30.07 | 82.9 | 50.15 | |
60.07 | 30.78 | 83.94 | 51.33 | |
65.57 | 29.34 | 88.39 | 52.22 | |
65.85 | 30.97 | 88.65 | 51.98 | |
58.11 | 30.1 | 79.16 | 49.93 | |
58.98 | 31.29 | 83.02 | 50.34 | |
59.62 | 31.83 | 84.31 | 50.68 | |
58.23 | 30.97 | 80.74 | 49.41 | |
48.66 | 66.69 | 39.5 | ||
57.91 | 70.21 | 44.9 | ||
53.44 | 28.54 | 68.65 | 40.76 | |
60.35 | 30.98 | 81.45 | 48.17 | |
57.88 | 30.28 | 78.13 | 49.2 | |
60.28 | 31.42 | 82.04 | 49.72 | |
60.59 | 29.25 | 74.31 | 47.86 | |
62.72 | 31.01 | 79.54 | 50.87 |
STS Leaderboard 🤖
Model | BIOSSES | SICK-R | STS12 | STS13 | STS14 | STS15 | STS16 | STS17 (en-en) | STS22 (en) | STSBenchmark |
|---|---|---|---|---|---|---|---|---|---|---|
62.01 | 62.86 | 62.6 | 59.62 | 57.03 | 71.57 | 70.75 | 76.73 | 39.76 | 69.77 | |
78.7 | 69.99 | 65.08 | 67.98 | 64.03 | 76.59 | 72.98 | 79.45 | 60.97 | 72.25 | |
83.57 | 79.32 | 73.08 | 82.13 | 76.73 | 85.58 | 80.23 | 88.63 | 65.67 | 83.09 | |
81.64 | 77.58 | 72.37 | 80.6 | 75.59 | 85.39 | 78.99 | 87.59 | 67.21 | 82.03 | |
80.43 | 80.59 | 72.63 | 83.48 | 78 | 85.66 | 80.03 | 90.6 | 67.95 | 83.42 | |
64.95 | 56.39 | 62.49 | 58.7 | 54.87 | 62.54 | 64.27 | 69.63 | 55.06 | 61.26 | |
54.7 | 58.65 | 30.87 | 59.89 | 47.73 | 60.29 | 63.73 | 64.1 | 56.37 | 47.29 | |
83.32 | 70.2 | 64.34 | 80.03 | 74.51 | 83.3 | 79.67 | 86.32 | 64.64 | 78.81 | |
44.93 | 55.43 | 54.64 | 69.16 | 60.81 | 72.31 | 65.34 | 77.95 | 56.35 | 61.54 | |
79 | 71.45 | 68.59 | 79.09 | 74.64 | 84.85 | 81.57 | 85.8 | 66.17 | 79.58 | |
84.86 | 73.39 | 70.33 | 82.19 | 77.16 | 86.31 | 81.85 | 83.93 | 64.3 | 77.6 | |
78.94 | 73.63 | 69.11 | 81.82 | 77.07 | 86.01 | 82.23 | 84.9 | 66.61 | 77.65 | |
81.91 | 74.29 | 70.12 | 82.72 | 78.24 | 86.26 | 81.61 | 85.18 | 65.76 | 77.73 | |
50.25 | 55.49 | 53.51 | 70.8 | 63.56 | 74.08 | 64.6 | 76.91 | 53.89 | 61.55 | |
77.32 | 72 | 68.19 | 80.4 | 74.02 | 82.57 | 79.78 | 85.94 | 67.54 | 76.97 | |
74.18 | 79.61 | 76.02 | 80.7 | 78.85 | 85.84 | 81.05 | 86.87 | 61.72 | 84.42 | |
76.27 | 79.62 | 77.9 | 85.11 | 80.81 | 87.48 | 83.2 | 86.99 | 63.06 | 86.82 | |
75.89 | 80.18 | 78.05 | 85.85 | 82.19 | 87.46 | 84.03 | 89.57 | 62.66 | 85.52 | |
78.93 | 80.34 | 79.11 | 87.33 | 83.17 | 88.28 | 84.36 | 88.99 | 62.39 | 85.36 | |
73.12 | 79.98 | 79.02 | 88.8 | 84.33 | 88.89 | 85.31 | 88.91 | 64.32 | 83.93 | |
80.43 | 80.47 | 78.85 | 88.94 | 84.86 | 89.32 | 84.67 | 89.46 | 65.33 | 84.01 | |
68.38 | 80.77 | 75.3 | 84.67 | 80.19 | 85.4 | 80.82 | 89.44 | 61.96 | 84.25 | |
86.35 | 80.6 | 69.8 | 83.27 | 76.09 | 86.12 | 85.96 | 90.25 | 68.12 | 83.17 | |
78.04 | 77.48 | 72.3 | 81.49 | 74.74 | 84.28 | 82.06 | 87.08 | 64.71 | 83.78 | |
78.12 | 77.02 | 84.32 | ||||||||
77.46 | 77.26 | 83.02 | ||||||||
68.95 | 78.72 | 84.08 | ||||||||
72.31 | 72.24 | 66.05 | 81.49 | 73.61 | 79.72 | 78.12 | 83.58 | 59.65 | 76.52 | |
83.02 | 67.23 | 66.59 | 77.33 | 71.83 | 80.66 | 78.91 | 86.99 | 67.3 | 77.59 | |
75.21 | 65.93 | 66.53 | 76.17 | 69.05 | 79.24 | 76.07 | 84.95 | 65.66 | 75.34 | |
70.93 | 74.57 | 69.17 | 77.23 | 70.99 | 79.74 | 77.93 | 87.33 | 59.64 | 79.54 | |
84.84 | 68.2 | 66.99 | 77.58 | 72.78 | 82.62 | 80.1 | 87.25 | 68.75 | 79.21 | |
86.25 | 69.63 | 67.5 | 79.16 | 74.46 | 84.47 | 80.96 | 87.78 | 69.35 | 81.39 | |
79.5 | 79.59 | 74.29 | 85.35 | 79.21 | 85.52 | 82.54 | 90.44 | 63.2 | 85.67 | |
85.31 | 69.82 | 69.66 | 79.67 | 74.61 | 83.81 | 80.4 | 87.07 | 66.13 | 80.9 | |
84.22 | 78.9 | 75.19 | 81.8 | 78.48 | 87.49 | 84.58 | 87.94 | 63.76 | 86.36 | |
84.39 | 81.27 | 76.28 | 88.18 | 81.92 | 89.01 | 85.49 | 90.3 | 67.74 | 86.88 | |
82.31 | 80.26 | 77.02 | 86.58 | 81.32 | 88.19 | 84.88 | 89.46 | 66.45 | 86.43 | |
84.15 | 81.7 | 75.32 | 87.44 | 81.87 | 88.94 | 85.38 | 90.54 | 68.65 | 86.56 | |
85.1 | 79.66 | 74.22 | 83.31 | 78.52 | 88.35 | 84.15 | 87.23 | 62.88 | 86.18 | |
84.73 | 80.49 | 75.93 | 85.22 | 80.54 | 88.81 | 85.28 | 89.37 | 62.99 | 87.21 | |
71.13 | 77.46 | 72.98 | 85.52 | 79.87 | 85.35 | 81.96 | 90.16 | 60.92 | 84.65 | |
80.43 | 80.59 | 72.63 | 83.48 | 78 | 85.66 | 80.03 | 90.6 | 67.95 | 83.42 | |
79.14 | 76.43 | 74.25 | 71.82 | 71.38 | 82.47 | 77.54 | 86.38 | 52.85 | 81.24 | |
78.19 | 74.43 | 72.58 | 72.22 | 69.98 | 82.22 | 76.91 | 85.22 | 61.9 | 80.28 | |
63.38 | 69.79 | 67.06 | 71.54 | 70.59 | 80.27 | 75.76 | 84.94 | 60 | 77.08 | |
69.36 | 76.84 | 72.49 | 73.65 | 71.88 | 82.9 | 79.83 | 85.19 | 48.44 | 79.93 | |
65.29 | 76.01 | 71.25 | 78.4 | 74.23 | 81.41 | 79.13 | 85.4 | 58.63 | 81.34 | |
79.43 | 78.51 | 76.21 | 82.4 | 79 | 87.76 | 83.8 | 87.72 | 63.15 | 85.95 | |
81.4 | 78.3 | 75.79 | 83.58 | 79.95 | 88.82 | 84.46 | 87.58 | 64.07 | 86.52 | |
83.6 | 79.28 | 76.95 | 84.12 | 80.46 | 89.76 | 85.47 | 89.03 | 64.11 | 87.74 | |
85.06 | 78.51 | 76.7 | 78.03 | 76.6 | 88.16 | 84.28 | 87.83 | 61.83 | 85.64 | |
67.85 | 57.32 | 42.8 | 58.77 | 53.36 | 69.23 | 58.81 | 68.6 | 52.67 | ||
66.16 | 79.97 | 80.91 | 82.86 | 87.36 | 88.31 | 81.61 | 85.81 | 62.99 | 86.45 | |
73.97 | 68.99 | 58.5 | 74.03 | 66.18 | 75.55 | 73.71 | 80.14 | 65.65 | 71.4 | |
82.26 | 77.51 | 76.56 | 76.97 | 75.52 | 87.12 | 83.63 | 86.44 | 60.94 | 84.01 | |
82.51 | 80.23 | 80.02 | 81.55 | 77.72 | 89.31 | 85.78 | 88.12 | 63.06 | 87.29 | |
80.46 | 72.44 | 73.64 | 78.04 | 74.54 | 83.89 | 79.04 | 86.77 | 64.28 | 78.84 | |
82.64 | 75.04 | 73.51 | 79.15 | 75.24 | 85.12 | 80.07 | 87.96 | 66.08 | 81.69 |
STS Multilingual Leaderboard 👽
Model | BIOSSES | SICK-R | STS12 | STS13 | STS14 | STS15 | STS16 | STS17 (ar-ar) | STS17 (en-ar) | STS17 (en-de) | STS17 (en-en) | STS17 (en-tr) | STS17 (es-en) | STS17 (es-es) | STS17 (fr-en) | STS17 (it-en) | STS17 (ko-ko) | STS17 (nl-en) | STS22 (ar) | STS22 (de) | STS22 (de-en) | STS22 (de-fr) | STS22 (de-pl) | STS22 (en) | STS22 (es) | STS22 (es-en) | STS22 (es-it) | STS22 (fr) | STS22 (fr-pl) | STS22 (it) | STS22 (pl) | STS22 (pl-en) | STS22 (ru) | STS22 (tr) | STS22 (zh) | STS22 (zh-en) | STSBenchmark |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
62.01 | 62.86 | 62.6 | 59.62 | 57.03 | 71.57 | 70.75 | 67.47 | 65.05 | 66.66 | 76.73 | 70.05 | 55.3 | 79.67 | 70.82 | 70.98 | 70.52 | 68.12 | 42.57 | 25.69 | 32.35 | 37.41 | 15.67 | 39.76 | 54.92 | 54.34 | 42.21 | 58.61 | 39.44 | 60.31 | 18.34 | 53.63 | 39.24 | 36.97 | 49.41 | 46.19 | 69.77 | |
78.7 | 69.99 | 65.08 | 67.98 | 64.03 | 76.59 | 72.98 | 69.07 | 74.51 | 73.85 | 79.45 | 72.07 | 65.71 | 80.83 | 76.98 | 76.99 | 71.32 | 75.22 | 57.67 | 48.58 | 50.14 | 53.28 | 58.69 | 60.97 | 63.18 | 71.86 | 69.69 | 77.95 | 61.98 | 72.22 | 39.3 | 69.41 | 57.49 | 58.15 | 63.02 | 64.02 | 72.25 | |
83.57 | 79.32 | 73.08 | 82.13 | 76.73 | 85.58 | 80.23 | 58.71 | 0.54 | 27.54 | 88.63 | 0.43 | 22.01 | 78.37 | 30.7 | 24.28 | 43.37 | 24.51 | 17.54 | 22.53 | 42.86 | 43.52 | 1.63 | 65.67 | 43.98 | 53.99 | 40.71 | 69.51 | 16.9 | 47.48 | 19.22 | 42.67 | 11.19 | 21.6 | 33.15 | 44.39 | 83.09 | |
81.64 | 77.58 | 72.37 | 80.6 | 75.59 | 85.39 | 78.99 | 50.89 | -4.28 | 35.82 | 87.59 | 4.5 | 16.31 | 76.12 | 37.09 | 24.45 | 43.39 | 29 | 22.64 | 31.04 | 44.04 | 30.07 | 4.93 | 67.21 | 54.78 | 53.42 | 44.27 | 77 | 50.71 | 60.4 | 26.77 | 32.8 | 14.72 | 33.69 | 44.93 | 41.64 | 82.03 | |
80.43 | 80.59 | 72.63 | 83.48 | 78 | 85.66 | 80.03 | 90.6 | 67.95 | 83.42 | ||||||||||||||||||||||||||||
64.95 | 56.39 | 62.49 | 58.7 | 54.87 | 62.54 | 64.27 | 27.14 | 6.9 | 11.59 | 69.63 | 6.46 | 10.86 | 55.45 | 16.02 | 19.87 | 8.08 | 24.92 | 19.57 | 17.31 | 26.03 | 10.26 | 16.94 | 55.06 | 48.89 | 51.79 | 25.24 | 53.92 | 39.44 | 39.43 | 13.56 | 25.36 | 1.11 | 31.73 | 16.35 | 8.44 | 61.26 | |
54.7 | 58.65 | 30.87 | 59.89 | 47.73 | 60.29 | 63.73 | 64.1 | 56.37 | 47.29 | ||||||||||||||||||||||||||||
83.32 | 70.2 | 64.34 | 80.03 | 74.51 | 83.3 | 79.67 | 86.32 | 64.64 | 78.81 | ||||||||||||||||||||||||||||
44.93 | 55.43 | 54.64 | 69.16 | 60.81 | 72.31 | 65.34 | 77.95 | 56.35 | 61.54 | ||||||||||||||||||||||||||||
79 | 71.45 | 68.59 | 79.09 | 74.64 | 84.85 | 81.57 | 85.8 | 66.17 | 79.58 | ||||||||||||||||||||||||||||
84.86 | 73.39 | 70.33 | 82.19 | 77.16 | 86.31 | 81.85 | 10.19 | -5.77 | 67.43 | 83.93 | 8.75 | 54.96 | 82.74 | 60.5 | 46.26 | 8.96 | 47.48 | 34.97 | 51.7 | 48.76 | 57.5 | 32.76 | 64.3 | 57.49 | 67.76 | 57.18 | 78.7 | 61.98 | 67.67 | 30.68 | 54.17 | 15.36 | 58.12 | 27.32 | 29.42 | 77.6 | |
78.94 | 73.63 | 69.11 | 81.82 | 77.07 | 86.01 | 82.23 | 9.06 | -3.22 | 70.38 | 84.9 | 17.17 | 60.24 | 81.93 | 62.17 | 59.11 | 8.9 | 56.91 | 37.66 | 50.58 | 53.63 | 55.72 | 27.99 | 66.61 | 59.14 | 69.99 | 60.94 | 79.43 | 61.98 | 67.14 | 33.74 | 60.18 | 32.69 | 55.79 | 31.16 | 28.85 | 77.65 | |
81.91 | 74.29 | 70.12 | 82.72 | 78.24 | 86.26 | 81.61 | 85.18 | 65.76 | 77.73 | ||||||||||||||||||||||||||||
50.25 | 55.49 | 53.51 | 70.8 | 63.56 | 74.08 | 64.6 | 13.78 | 9.08 | -3.11 | 76.91 | -0.45 | -8.18 | 48.23 | 5.81 | 3.64 | 2.54 | 0.44 | 32.42 | 33.04 | 28.65 | 14.77 | 11.21 | 53.89 | 48.53 | 26.97 | 41.1 | 49.43 | 39.44 | 57.77 | 12.47 | 45.55 | 19.44 | 47.38 | 4.78 | 14.05 | 61.55 | |
77.32 | 72 | 68.19 | 80.4 | 74.02 | 82.57 | 79.78 | 85.94 | 67.54 | 76.97 | ||||||||||||||||||||||||||||
74.18 | 79.61 | 76.02 | 80.7 | 78.85 | 85.84 | 81.05 | 79.16 | 81.22 | 84.22 | 86.87 | 76.74 | 84.44 | 85.56 | 76.59 | 82.35 | 77.03 | 81.71 | 46.2 | 44.64 | 52.65 | 51.73 | 44.22 | 61.72 | 56.56 | 67.33 | 47.67 | 70.55 | 50.71 | 55.22 | 33.74 | 69.02 | 57.08 | 53.39 | 58.75 | 65.71 | 84.42 | |
76.27 | 79.62 | 77.9 | 85.11 | 80.81 | 87.48 | 83.2 | 79.1 | 80.85 | 83.28 | 86.99 | 74.9 | 86.11 | 85.14 | 81.17 | 84.24 | 83.41 | 82.51 | 52.19 | 46.7 | 50.81 | 62.34 | 40.53 | 63.06 | 59.91 | 70.26 | 53.7 | 74.3 | 84.52 | 60.65 | 33.65 | 73.07 | 58.74 | 56.3 | 61.75 | 67.96 | 86.82 | |
75.89 | 80.18 | 78.05 | 85.85 | 82.19 | 87.46 | 84.03 | 13.36 | -5.65 | 67.11 | 89.57 | -0.02 | 47.72 | 79.94 | 56.61 | 30.46 | 10.06 | 36.46 | 31.2 | 42.08 | 46.9 | 55.04 | 33.94 | 62.66 | 53.81 | 65.19 | 55.29 | 77.69 | 28.17 | 60.65 | 24.42 | 42.97 | 12.13 | 40.45 | 32.9 | 20.15 | 85.52 | |
78.93 | 80.34 | 79.11 | 87.33 | 83.17 | 88.28 | 84.36 | 10.75 | -4.71 | 73.62 | 88.99 | -0.42 | 62.62 | 82.74 | 67.86 | 51.86 | 9.44 | 45.95 | 27.01 | 43.73 | 49.93 | 61.58 | 38.83 | 62.39 | 57.68 | 68.09 | 61.58 | 75.01 | 5.63 | 62.01 | 25 | 51.72 | 14.21 | 47.3 | 30.47 | 23.1 | 85.36 | |
73.12 | 79.98 | 79.02 | 88.8 | 84.33 | 88.89 | 85.31 | 11.13 | -3.93 | 79.04 | 88.91 | 13.61 | 71.72 | 83.42 | 71.38 | 69.5 | 9.61 | 66.12 | 29.6 | 47.72 | 49.64 | 62.21 | 34.34 | 64.32 | 58.16 | 69.15 | 65.26 | 77.49 | 50.71 | 66.91 | 27.04 | 58.85 | 26.63 | 43.36 | 33.55 | 29 | 83.93 | |
80.43 | 80.47 | 78.85 | 88.94 | 84.86 | 89.32 | 84.67 | 89.46 | 65.33 | 84.01 | ||||||||||||||||||||||||||||
68.38 | 80.77 | 75.3 | 84.67 | 80.19 | 85.4 | 80.82 | 89.44 | 61.96 | 84.25 | ||||||||||||||||||||||||||||
86.35 | 80.6 | 69.8 | 83.27 | 76.09 | 86.12 | 85.96 | 90.25 | 68.12 | 83.17 | ||||||||||||||||||||||||||||
78.04 | 77.48 | 72.3 | 81.49 | 74.74 | 84.28 | 82.06 | 87.08 | 64.71 | 83.78 | ||||||||||||||||||||||||||||
78.12 | 77.02 | 84.32 | |||||||||||||||||||||||||||||||||||
77.46 | 77.26 | 83.02 | |||||||||||||||||||||||||||||||||||
68.95 | 78.72 | 84.08 | |||||||||||||||||||||||||||||||||||
72.31 | 72.24 | 66.05 | 81.49 | 73.61 | 79.72 | 78.12 | 83.58 | 59.65 | 76.52 | ||||||||||||||||||||||||||||
83.02 | 67.23 | 66.59 | 77.33 | 71.83 | 80.66 | 78.91 | 86.99 | 67.3 | 77.59 | ||||||||||||||||||||||||||||
75.21 | 65.93 | 66.53 | 76.17 | 69.05 | 79.24 | 76.07 | 55.62 | 8.21 | 30.18 | 84.95 | 1.04 | 28.78 | 71.88 | 26.34 | 20.73 | 52.39 | 25.05 | 28.19 | 21.99 | 53.07 | 32.97 | 20.45 | 65.66 | 49.81 | 49.51 | 45.78 | 67.66 | 61.98 | 48.25 | 23.31 | 36.8 | 9.07 | 34.66 | 25.49 | 28.68 | 75.34 | |
70.93 | 74.57 | 69.17 | 77.23 | 70.99 | 79.74 | 77.93 | 54.16 | 1.72 | 25.48 | 87.33 | 2.09 | 21.93 | 67.8 | 18.91 | 16.39 | 45.66 | 23.49 | 5.17 | 11 | 53.93 | 25.11 | 20.94 | 59.64 | 43.05 | 32.74 | 35.99 | 54.56 | 5.63 | 33.68 | 14.91 | 20.54 | 3.36 | 3.82 | 6.52 | 26.71 | 79.54 | |
84.84 | 68.2 | 66.99 | 77.58 | 72.78 | 82.62 | 80.1 | 87.25 | 68.75 | 79.21 | ||||||||||||||||||||||||||||
86.25 | 69.63 | 67.5 | 79.16 | 74.46 | 84.47 | 80.96 | 87.78 | 69.35 | 81.39 | ||||||||||||||||||||||||||||
79.5 | 79.59 | 74.29 | 85.35 | 79.21 | 85.52 | 82.54 | 90.44 | 63.2 | 85.67 | ||||||||||||||||||||||||||||
73.13 | 58.54 | ||||||||||||||||||||||||||||||||||||
85.31 | 69.82 | 69.66 | 79.67 | 74.61 | 83.81 | 80.4 | 76.42 | 78.07 | 59.1 | 87.07 | 11.8 | 78.22 | 86 | 80.46 | 51.58 | 66.89 | 45.85 | 58.67 | 30.05 | 51.16 | 53.28 | 43.05 | 66.13 | 65.41 | 75.06 | 65.5 | 80.38 | 28.17 | 65.65 | 31.13 | 53.31 | 43.36 | 47.14 | 66.78 | 68.45 | 80.9 | |
84.22 | 78.9 | 75.19 | 81.8 | 78.48 | 87.49 | 84.58 | 87.94 | 63.76 | 86.36 | ||||||||||||||||||||||||||||
84.39 | 81.27 | 76.28 | 88.18 | 81.92 | 89.01 | 85.49 | 90.3 | 67.74 | 86.88 | ||||||||||||||||||||||||||||
82.31 | 80.26 | 77.02 | 86.58 | 81.32 | 88.19 | 84.88 | 89.46 | 66.45 | 86.43 | ||||||||||||||||||||||||||||
84.15 | 81.7 | 75.32 | 87.44 | 81.87 | 88.94 | 85.38 | 90.54 | 68.65 | 86.56 | ||||||||||||||||||||||||||||
85.1 | 79.66 | 74.22 | 83.31 | 78.52 | 88.35 | 84.15 | 87.23 | 62.88 | 86.18 | ||||||||||||||||||||||||||||
84.73 | 80.49 | 75.93 | 85.22 | 80.54 | 88.81 | 85.28 | 89.37 | 62.99 | 87.21 | ||||||||||||||||||||||||||||
71.13 | 77.46 | 72.98 | 85.52 | 79.87 | 85.35 | 81.96 | 90.16 | 60.92 | 84.65 | ||||||||||||||||||||||||||||
80.43 | 80.59 | 72.63 | 83.48 | 78 | 85.66 | 80.03 | 90.6 | 67.95 | 83.42 | ||||||||||||||||||||||||||||
79.14 | 76.43 | 74.25 | 71.82 | 71.38 | 82.47 | 77.54 | 86.38 | 52.85 | 81.24 | ||||||||||||||||||||||||||||
78.19 | 74.43 | 72.58 | 72.22 | 69.98 | 82.22 | 76.91 | 85.22 | 61.9 | 80.28 | ||||||||||||||||||||||||||||
63.38 | 69.79 | 67.06 | 71.54 | 70.59 | 80.27 | 75.76 | 84.94 | 60 | 77.08 | ||||||||||||||||||||||||||||
69.36 | 76.84 | 72.49 | 73.65 | 71.88 | 82.9 | 79.83 | 85.19 | 48.44 | 79.93 | ||||||||||||||||||||||||||||
65.29 | 76.01 | 71.25 | 78.4 | 74.23 | 81.41 | 79.13 | 76.04 | 77.6 | 70.4 | 85.4 | 71.04 | 81.59 | 82.77 | 77.16 | 81.52 | 77 | 80.7 | 52.61 | 41.84 | 49.09 | 50.6 | 50.44 | 58.63 | 57.23 | 67.29 | 57.93 | 72.79 | 73.25 | 64.17 | 36.37 | 67.72 | 53.35 | 52.71 | 60 | 64.45 | 81.34 | |
79.43 | 78.51 | 76.21 | 82.4 | 79 | 87.76 | 83.8 | 87.72 | 63.15 | 85.95 | ||||||||||||||||||||||||||||
81.4 | 78.3 | 75.79 | 83.58 | 79.95 | 88.82 | 84.46 | 87.58 | 64.07 | 86.52 | ||||||||||||||||||||||||||||
83.6 | 79.28 | 76.95 | 84.12 | 80.46 | 89.76 | 85.47 | 89.03 | 64.11 | 87.74 | ||||||||||||||||||||||||||||
85.06 | 78.51 | 76.7 | 78.03 | 76.6 | 88.16 | 84.28 | 74.52 | 71.27 | 82.09 | 87.83 | 63.33 | 76.5 | 86.74 | 80.18 | 80.15 | 79.95 | 79.25 | 57.87 | 55.95 | 54.93 | 59.47 | 39.35 | 61.83 | 66.58 | 73.99 | 66.46 | 74.8 | 73.25 | 77.76 | 34.13 | 70.37 | 60.66 | 63.7 | 65.63 | 69.92 | 85.64 | |
67.85 | 57.32 | 42.8 | 58.77 | 53.36 | 69.23 | 58.81 | 68.6 | 52.67 | |||||||||||||||||||||||||||||
66.16 | 79.97 | 80.91 | 82.86 | 87.36 | 88.31 | 81.61 | 78.03 | 78.6 | 81.48 | 85.81 | 76.34 | 81.81 | 87.91 | 78.06 | 80.98 | 68.24 | 81 | 54.51 | 46.89 | 45 | 49.43 | 39.32 | 62.99 | 58.94 | 67.71 | 50.79 | 74.1 | 73.25 | 65.86 | 34.81 | 60.17 | 54.51 | 57.29 | 63.24 | 61.29 | 86.45 | |
73.97 | 68.99 | 58.5 | 74.03 | 66.18 | 75.55 | 73.71 | 80.14 | 65.65 | 71.4 | ||||||||||||||||||||||||||||
82.26 | 77.51 | 76.56 | 76.97 | 75.52 | 87.12 | 83.63 | 73.03 | 57.41 | 77.24 | 86.44 | 55.97 | 72.44 | 84.84 | 72.29 | 77.33 | 78.87 | 75.38 | 56.65 | 53.45 | 56.49 | 60.57 | 28.24 | 60.94 | 66.88 | 74.57 | 71.81 | 76.58 | 84.52 | 76.53 | 35.79 | 72.69 | 59.9 | 63.71 | 66.84 | 63.74 | 84.01 | |
82.51 | 80.23 | 80.02 | 81.55 | 77.72 | 89.31 | 85.78 | 77.88 | 75.06 | 86.16 | 88.12 | 71.23 | 80.75 | 86.74 | 85.62 | 84.54 | 82.27 | 85.28 | 56.99 | 56.59 | 56.6 | 67.79 | 49.58 | 63.06 | 64.58 | 72.52 | 68.93 | 76.79 | 50.71 | 76.98 | 34.68 | 65.54 | 59.9 | 63.55 | 66.82 | 66 | 87.29 | |
80.46 | 72.44 | 73.64 | 78.04 | 74.54 | 83.89 | 79.04 | 86.77 | 64.28 | 78.84 | ||||||||||||||||||||||||||||
82.64 | 75.04 | 73.51 | 79.15 | 75.24 | 85.12 | 80.07 | 87.96 | 66.08 | 81.69 |
Summarization Leaderboard 📜
Model | SummEval |
|---|---|
26.8 | |
31.05 | |
27.9 | |
30.81 | |
27.49 | |
27.66 | |
29.82 | |
30.36 | |
28.87 | |
29.67 | |
29.5 | |
30.21 | |
30.64 | |
30.49 | |
29.5 | |
30.67 | |
31.57 | |
31.39 | |
29.64 | |
29.91 | |
30.08 | |
31.17 | |
30.8 | |
26.94 | |
31.15 | |
30.43 | |
29.71 | |
30.26 | |
31.03 | |
31.46 | |
30.38 | |
33.6 | |
31.39 | |
31.84 | |
29.85 | |
32.32 | |
31.01 | |
30.97 | |
30.15 | |
27.49 | |
29.71 | |
30.79 | |
29.42 | |
29.01 | |
31.16 | |
30.28 | |
30.19 | |
30.11 | |
30.62 | |
30.1 | |
29.02 | |
29.98 | |
29.69 | |
28.96 | |
30.08 |
Made with ❤️ for NLP. If this work is useful to you, please consider citing:
@article{muennighoff2022mteb,
doi = {10.48550/ARXIV.2210.07316},
url = {https://arxiv.org/abs/2210.07316},
author = {Muennighoff, Niklas and Tazi, Nouamane and Magne, Lo{\"\i}c and Reimers, Nils},
title = {MTEB: Massive Text Embedding Benchmark},
publisher = {arXiv},
journal={arXiv preprint arXiv:2210.07316},
year = {2022}
}